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ABSTRACT 

Three fiscal year 1987 deliverables due for the 
"Towar'^ a National Educational Testing Network: FeasibiTity Study of 
Duplex Design** are presented. The study is concerned with 
implementation of statewide and interstate testing of student 
attainment. The report includes: (1) a duplex design (DD) review 
paper discussing the means by which the DD will meet local and state 
information needs; (2) sample students* scorp reports from the 
Illinois pilot implementation of the design; and (3) item parameter 
estimates (IPEs) and standard errors for sub-skills of the eight 
second-stage forms of the duplex instrument used in Illinois. The DD 
review covers educational information needs, uses of attainment 
information, the combination of student achievement testing and 
assessment of curricular objectives, the contribution of modern Item 
Response Theory (IRT), adaptive testing, reporting results, and 
interstate comparisons. The California Assessment Program is 
described. The DD proposed supplies achievement scores for individual 
students in the main areas of proficiency and content, while 
evaluating the progress of schools in attaining the objectives of the 
instructional program and curriculum. The DD uses IRT, matrix 
sampling, and two-stage testing techniques. The IPEs are tabulated on 
24 pages. (TJH) 



**************************** 

* Reproductions supplied by EDRS are the best that can be made * 

* from the original document. * 
*******************************************<«*************************** 



ERIC 



UlS DCPAIVTMENT OF EDUCATION 

Office o( Educ«tKX\«l ReMtrCh and improvement 
EDUCATIONAL RESOURCES INFORMATION 
. CENTER (ERIC) 

^This document hss been reproduced «» 
received from the parson or orgen ration 
OngtnBting iL 

a Minor chingea hive been mad« to improve 
reproduction quality 



Points ot viewer opinions stated in this docu 
men* do not necessarily represent official 
OERl position or policy 



• PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 

LISA Sie6£t 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) " 



Centfer for Research on Evaluation, Standards, 
' and Student Testing 

"deliverable - September 1987 

PROJECT: TOWARD A NATIONAL EDUCATIONAL 
TESTING NETWORK 

"Final Report" 



Project Director: Darrell Bock 



Grant Number: OERI-G-86-0003 



Center for the wtudy of Evaluatioi» 
Graduate School of Education 
University of California, Los Angeles 



BEST COPY AVAlLAtIL}: 



The project presented, or reported herein, was performeci 
pursuant to a Grant from the Office of EducaticJnal Research 
and Improvement/Department of Education (OERI/ED) Howevei 
the opinions expressed herein do not necessarily^ reflect th 
position or policy of the OERI/ED and no official 
endorsement by the OERI/ED should .\n inferred. 



It • • 



Table 

Introduction/Overview 

I. ^ Cr)inprehen'Sive Educationa 

The Duplex Design 

II. Sample Score Reports from 

III. Item Parameter Estimates 



of Contents 

Assessment for the States: 
the Illinois Tryout 



ERIC 



4 



INTRODUCTION 



This report presents the three FY1937 d^iliverables due 
for the Toward a National Educational Testing Network: 
Feasibility Study of Duplex Design. Included ere the 
following documents: 

A. Duplex design review paper discussing topics of how 
the duplex design will meet local and state information 
needs; this paper will be published in Evaluation 
Comment . 

^. 'Sample score reports from the Illinois tryout. 
These include the student reports, one copy of which 
was supplied to the teacher and one to each student; 
the School reports supplied to the school principals 
and District Superintendents; and State reports 
provided to Districc Superintendents and to the 
Illinois State Board of Education. The three schools 
represented in these sample reports were drawn from the 
low, middle and high ability levels of the schools. 

C. Item parameter estimates and standard errors for 
subskills of the eight second-stage forms of the duplex 
instrument used in Illinois. The item designations 
include letters E, M and D to identify the easy, 
intermediate and difficult test booklets of the second 
stage forms. Items that are marked by two letters, for 
example E and M, are link items common to the 
corresponding test booklets. A three parameter 
logistic model was used. Items that fail to fit the 
model at the .05 level are marked by a single asterisk; 
those at the .01 level by a double asterick. Very* few 
items in t^e entire set of 888 failed to ^it the model. 



I. Comprehensive Educational Assessment for the 
States: The Duplex Design 
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COMPREHENSIVE 
EDUCATIONAL 
ASSESSMENT FOR THE STATES? 
^ TBE DUPLEX DESIGN^ 



R. Darrell Bock 
University of Chicago 
and 

Robert J. IVIislevy 
Educational Testing Service 

According to a 19S5 survey, 47 of the 50 states mandate sone form of 
statewide testing of student attainnnent (Winneld, 19S6). These testing pro- 
grams vary widely in design: some employ traditional every-pupil achieve- 
ment testing, others are limited to minimum competency testing, still others 
make use of matrix sampled assessment at benchmark grade levels. 

The most widespread program is minimum compeiency testing: 23 states 
have centrally directed programs, and another 16 allow local, options "of test 
content and admirJstration; in 23 of these 39 states, satisfactory performance 
on the test is a requirement for high school graduation. Standards for passing 
are set variously by state legislatures, state boards ot education, and local 
education authorities. 

Many states have multiple programs, usually some combmation of out- 
come assessment and individual achievennent testing. States that have achieve- 
ment measurement or minimum competency programs test every pupil at 
selected grade levels, but some of those using matrix sampled assessment 
test in a sample of schools. Others, such as California, use matrix sampling 

'We are indebted to Linda Winfield, Leigh Burstcin, Daviu Wiiey, Zalman Usiskin, Tej 
Pandey, Pat McCabe, Joan Baron and Mervin Brennan for valuable suggestions. Prepara- 
tion of this paper was supported in part by the Center for Student Testing, Evaluation and 
Standards, School of Education, UCLA, and in part by agranl from the Spencer Foundation. 
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methods, but test in all schools. 

California is a prime example of a mulciple-prograrn state: the Califor- 
nia Assessment Program provides curriculum-oriented evaluations of school 
outcomes; local school systems axe required to conduct their own minimum 
competency Jesting: and data from t-he National Assessment of Educational 
J^rog^ess (NAJbE^-are available in CaHfornia for purposes of comparison with 
national results. 

States that have no centrally directed program may nevertheless require 
the districts to conduct periodic achievement testing. In Iowa, all districts 
test annually and, in fact, all use the sam.e test. Finally, end-of-high-school 
tests in specialized subject matter areas aje administered to selected students 
in some states (New York State Regents Examination, California Golden 
State examination). Winfield (19S6) and Eurstein, et ai. (1985) give detailed 
accounts of existing and projected state testing programs. 

Considering that the information needed to assess educational produc- 
tivity must be much the same in all states, the variety of these programs 
is at first glance surprising. Closer examination reveals, however, that they 
arise from different emphases on outcomes -for which school^; should be held 
responsible. Where the niain concern is certification of essential skills and 
knowledge, minimum competency testing is emphasized. Where the focus 
is on student attainment at all levels, especially when student gviidance is 
involved, a commerrial achievement testing program is usually relied uppn. 
Where progress toward detailed curricular objectives is monitpred, a matrix- 
sampling assessment program is the only practical approach. To the extenf^ 
that mandated testing is committed to these disparate goals, the multiplicity 
of the existing state programs, with limited comparability of the resulting 
data, would seem to be inevitable. 

We will argue, however, that with a suitable measuiement design, a sin- 
gle, comprehensive assessment program can serve all of these purposes. We 
base this conclusion on an analysis of the information needs of the main 
users of educational test results within the states. The design we propose 
meets their needs directly and efficiently. In particular, it provides measures 
of achievement suitable for certifying attainment, for counseling s,.udents 
and parents, and for monitoring the effectiveness of schools and school dis- 
tricts. At the same time, it offers the detail and precision necessary for the 
evaluation of instructional methods and materials, and for basic educational 
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research. Moreo'v'er, it performs these functions in a cost-effective manner. 
We also suggest how results from incependeat state assessments based on 
the duplex design can be referred to a common scale to allow comparisons 
among states. 

JL. Ecjucaflqnal information users 

Anyone concerned with the conduct of education is conscious of the need 
for regular appraisals of student progress. Without such information, there 
can be no objective basis for guiding the student, for planning instruction, 
for evaluating schools, school systems and programs, or for correcting defi- 
ciencies or rewarding progress. It is not a^ well understood, however, that 
different forms of information about educational outcomes are required in 
these different applications. The first step in form'ilating the design must, 
be an analysis of the anticipated uses of the resulls. These uses depend, of 
course, upon the users of the information. We delineate seven categories of 
such users. 

Teachers, school counselors, parents, and the student Standardized indi- 
vidual achievement tests, independent of particular teachers or courses, are 
widely used as aids to informed and fair decisions on student advaincement 
and placement. In this role, the tests must have three important charac- 
teristics: 1) they must cover content that is relevant to the course work for 
which the student is responsible; 2) they must be sufficiently reliabte that 
scores on alternative forms of the same test will, with high probability, lead 
to the same recommendations on individual advancement or placement; 3/ 
the results must be presented in a form readily understandable to the parties 
involved. 

Typically, content coverage is assured by specification of domains defined 
by a taxonomy of subject-m.atter topics. Items then are written for each 
category of the domain specification. The validity of the item classification 
may be checked empirically by inspection of the item-by-test score correla- 
tions, or by factor analyzing intercorrelations among items in a given content 
area. For the most part, writing items is reasonably straightforward once ♦'he 
domain specification h?s been formulated. 

To construct from such items a number of test forms that will produce 
consistent difi"erential measurement of students is, however, a more difficult 



task. The problem is that decisions about students are made at all levels 
of the score distribution.; low ranking students may be kept back or sent 
to remedial programs; higli ranking students may be put ahead of their 
grade or assigned to honors programs: students in the middle range may be 
assigned to tracked classrooms difierentially. To be accurate over the entire 
jange^ an achievement test must have a sumclent number of items to measure 
accurately at difnculty levels throughout the expected score distribution. To 
span this wide a range, an individual achievem.ent test must be rather long. 

As a result the testing time available usually restricts the number of pro- 
ficiencies that can be tested to a relatively small number. A test that reliably 
estimates achievement in six areas, for example, may require three to four 
hours to administer. A major problem in comprehensive assessment is how 
to reduce the time required for dependable measurement of individual stu-^ 
dent achievement. Fortunately, new methods of adaptive testing, described 
below, make such savings possible. 

In communicating achievement test results to teachers, parents, and stu- 
dents, we depend upon the normative nature of guidance-oriented use of test 
information. Teachets rarely make decisions about the student on an abso- 
lute basis; they can single out for special treatment only those students who 
deviate from the local standard. Because only rank-oMer information is re- 
quired for such decisions, any form of reporting that indicates the student's 
standing in a reference group is suitable. In other words, "norm referenced" 
reporting is quite adequate for guidance purposes. ♦ 

Designers of sarricula and planners of insiritction. In designing curnciila or 
developing instructional methods and materials for the classroom, it is not 
the individual student that is to be evaluated, but the overall performance of 
students taught under different conditions. Although the classroom teacher 
has an Interest in the outcome of such evaluations, it is primarily the school 
department head and principal, the professional curriculum specialist, and 
the textbook and workbook writer who w^ill make direct use of these re- 
sults. These workers need much more detail about student attainment than 
is available in traditional achievement testing. The problem is that measures 
of broad content areas produced by achievement tests ^end to be insensitive 
to differential curricular effects. Although It has not been emphasized in the 
evaluation litera ure, this fact has been am])ly demonstrated in empirical 
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studies of alternative curricula. Walker t Schafiarzick (1974), In a lengthy 
review of research on science and mathematics curricula from 1956 to 1972, 
found that any given curriculum tends to be superior to others only in respect 
to material that is distinctive to It. Wliere the content and presentation are 
comnon amqng curric* la, all perform equally vrell; thus, the differential out- 
corses are see:i^ contrasting score profiles, not in overall performance. A 
coroUarj- of this finding Is that the tests employed in such comparisons must 
be sufnciently detailed to measure separate outcomes for distinctive parts of 
the curricula. An instrument used to evaluate "new" math and tra-iitional 
math, for example, would have to produce reliable scores for both of these 
types of content. , 

By the same token, instructional planners need to examine student per- 
formance In the units of content that can be manipulated In instruction.^ 
To write lesson plans for mathematics, for example, the Instructors need to 
know the specific units-computation, niunber systems, problem-solving, ap- 
phcatlons, etc., that need attention. These units are almost always tested 
form.atively, but time restrictions necessarily prevent their separate evalua- 
tion during summatlve testing of individual achievement. 

The experience of the California Assessment Program suggests that, to 
be useful, an evaluation instrument must distinguish perhaps 20 to 40 cur- 
ricular objectives at a given grade level. Although It Is not possible to test 
this many, topics with Individual achievement tests, individual measurement 
Is not necessary ^In program evaluation: only the a.verage performance of 
classrooms or other experimental units need be measured for this purpose.. 
If the number of students In the programs is sufficiently large, g^)oS precision 
In estimating program effects can be obtained without the use of long tests. 
The generallzablllty of the group mean scores Is the Important consideration, 
not the reliability of scores for Individual students. 

It has been known for some time that to obtain adequate generalizabihty 
In -estimating program effects, evaluation should not be based on the tradi- 
tional achievement test, but on an instrument In which each student responds 
to only a few items sampled from each of num.erous content elements, while 
different students respord to different samples of items. This approach as- 
sures good generalizabllity of the group m.ean for each element with minimal 
demands on testing time. It Is the basis for the multiple matrix-sampling 
designs used in the National Assessment of Educational Progress and in 
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numerous state testing programs. In these designs, the test instrument is 
constructed in many forms, 15 to 30, or sometimes -.ore, with a small num- 
ber of items assigned randomly to each form from the pool representing each 
curricular objective or element. Lord (19S0) has sho^vn that the most effi- 
cient matrix ^ample is one in which each student in the group is assigned one 
dis:iry:t item frQCi each element. In that case, the number of cu:ricular ob- 
jectives that can be assessed in one form is then equal to the number of items 
that the student can respond to during the testing period, usually ?0 to 40. 
This number is quite adequate for a highly detailed curricular evaluation. 

The scoring of matrix sampled instruments is also different from that of 
achteveinent tests. In the original formulation of matrix sampling (see Lord, 
1962), the scores are not presented in any norma^i^•e form, but simply as 
average percent correct for each content element. Classrooms, groupings oS 
students, instructional programs, schools, and othex aggregations are then 
compared with respect to the strengths and weaknesses revealed in the profile 
of average percent correct scores over detailed curri^.ular elements. Since 
these element s usually correspond to units or topics of instruction, definite 
recommendations about teaching practices or emphasis can be made from 
such results. 

More recently, Bock, MisI evy and Woodson (19S1) have shown how matrix - 
sample data can also be analyzed and scored by use of scaling techniques 
based on item response theory (IRT). According to this theory, the praba- 
bility that a student will respond correctly to a given test ite;n is a fu'nction 
of the student's location on the proficiency dimension and of properties of 
the item, such as its difficulty and validity. The properties q| each of the 
items in a test can be estimated from large samples of responses and used 
to estimate a "scale score" for the student indicating his or her proficiency 
lev^l 

Average percent correct scoring and IRT scale scoring both retain the de- 
tail necessary for curricular evaluation and instructional planning, but scale 
scores have the adveintage of remaining comparable as items are added to 
or retired from the instrument from time to time. This consistency of inter- 
pretation as the item content is updated is essential if educational prcjresb 
is to be followed ov*er long periods of time. Recently developed IRT test 
maintenance systems provide for the detection and correction of drift in the 
relative difficulties of items that may occur over time. 
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Local school system managers, officers, and boards. In making decisions on 
personnel, resource adloca.'ion, and policy, school oScials must be able to 
support their actions with data en educational outcomes in the schools fcr 
which they are responsible In aadition to such operational statistics as num- 
ber of studen^^s in school, r-imber of hours of schooling, teacher/student ratio, 
etc., ^hey need ci^asures of outcomes in the relevant subject matter areas 
at a number of grade levels. The detail required depends somewhat on the 
style of administration or oversight of the persons involved. Superintendents 
and bocLids that have considerable experience with education and instruction 
probably will be interested in more detail than is available from achievement 
testing, although perhaps not to the same extent as the curriculum special- 
ist. They will not, however, be interested in a level of score reporting below 
that of the classroom or school. Because their concern is with group-leveK 
rather than individual outcomes, they can make profitable use of the ma- 
trix sampling methods of program evaluation. The only difference is that 
classrooms or schools rather than programs are being evaluated, a distinc- 
tion that is conveyed by describing the activity as "assessment" rather than 
"evaluation". 

Assessment procedures based on matrix sampling designs have the advan- 
tage of providing a detailed profile of aggregate outcomes without intruding 
excessively on classroom time. Equally advantageous, however, is their resis- 
tance to effects of "teaching to the test". Because there are so many item? in 
the forms that make up assessment instruments, ^t is difficult (or a teacher to 
discuss enough of the items to have any great effect on the schoo! outcome.^ 
Indeed, if the assessment represents the full range of curricula objectives, 
an attempt to teach a majority of the items would be virtually equivalent 
to teaching the subject matter of thfj course. In addition, if scale scoring is 
used, a proportion of items can be replaced periodically to protect further 
the integrity of the test. 

Achievement tests, in contrast, typically exist in only a few forms and are 
not always updated regularly. If school districts use the same achievement 
tests from year to year, the items tend to become known to the teachers, 
who may then consciously or unconsciously teach the specific infonnation 
required to answer particular items. If so, the tests will tend to show year- 
to-year average gains that do not reflect increased general knowledge of the 
subject matter on the part of the student. The moie pressure the teachers are 
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under to improve student outcomes, the greater the probability that these 
teaching-tO'the-test effects will appear. 

Whether the information on student progress comes from achievement 
tests or assessment, it is important to school officials that the :.cores be 
reported on a. scale with fixed origin and unit so that gains or losses in each 
>Subjsc{> matter Stfea can be compared over a period of years. The sort of rank 
order information that is acceptable for comparing individual students is not 
suitable for monitoring the progress of schools and school systems. Average 
number correct scores in assessment results have this property, but they have 
the disadvantage of losing their comparability if some items are retired from 
or added to the co .tent areas assessed. As Lord (1980) has discussed, IRT 
scoring of tests facilitates both the equating of test forms and the updating 
of item content wthin forms. This theory also allows accurate calculation olP" 
measurement error variances at all points on the scale. These error- variance 
estimates can in turn be used in obtaining efficient, weighted estimates when 
aggregating data to the school or district level, and in expressing results in 
the form of confidence intervals that convey uncertainty due to the sampling 
of both students and items. vVe discuss below these ?^d other contributions 
of item response theory to educational assessment. 

State departments of education. The activities of most state departments of 
education.are sufficiently varied t o benefit from all of the outcome measures 
described above. Departmeno^ chat formulate curricula or, set objectives 
need feedback frbm the a^ssessment of detailed curricular objectives. Most^ 
states employ for these activities professional specialists whose ^york depends 
critically on this type of information. At the same time, most departments 
of education are also concerned with the performance of schools as measured 
by numbers of students reaching or exceeding defined levels of achievement, 
w-hether minimal, ordinary, advanced, or outstanding. For these purposes, 
individual achievement measures ir " road subject matter aireas are required. 
For just this reason many states operate assessm.ent programs simultareously 
with conventional. In many cases commercial, achievement testing. 

Some states have limited assessment programs based on sampling of 
schools and students within schools. If the state also has a policy of ac- 
countability of school districts for levels of student attainment, however, this 
type of sampling is not sufficient, and a complete census based on every-pupil 
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testing Is preferable. The effort can be well repayed: because the census pro- 
vidis accurate Information ai the level of tie indi^'idual schools, results can 
^e reported In a form that Is interesting and Informative locally, and schools 
with exceptional outcome patterns can be identified throughout the state. K 
the state m^kes special grants to improve average student penormance, or 
jewa^ds such p€:formance financially, then i complete census is, of course, 
essential. 

An additional problem with a sampling assessment Is that the schools 
have no immediate payoff. Motivation for cooperation on the part of both 
staT and students Is minimal, and levels of performance may suffer as a 
result. Apart from the lower cost of sampling assessment, there Is little to 
recommend It over an every-pupll program. 

The quahty of information that state departments of education have a> 
their disposal is also generally better when the test data take the form of 
original response records of the individual students. Although districts may 
have the capability of scoring tests and reporting summary statistics, the 
information can be analyzed more consistently and in more detail if primary 
rather than secondary data are available to the department. 

State legislators and officials. At the state level, representatives not ex- 
clusively involved In education can attend only to rather general Indices of 
educational outcomes. They cannot go Into the detail that would Interest^the 
curriculum specialist, or even the more limited achievement profiles re'qulred 
for student counseling. Their concern Is primarily with the main subject 
matter areas measured at a few benchmark grade levels, e.g., ^,'8, and 12.' 
Often, year-to-year gains and losses are of m.ore Interest than absolute levels 
of attainment. The statistics necessary for these general summaries of edu- 
cational progress can readily be obtained by agg.'egating the more detailed 
assessment figures at the school or district level. The precision and gen- 
erallzablllty of these statistics will be so high that the confidence intervals 
required at lower levels of aggregation will seldom be necessary, although 
they can be calculated If required. If reported In the form of scale scores, 
the results will remain comparable over relatively long periods of time, and 
lung-run changes In the average performance of students In the state can be 
traced. 

By examining such data, state officials may be able to Infer the Impact 

1-9 

15 



of current sociJ trends on student performance (e.g., television viewing or 
microcomputer use). They may then be able to anticipate; educational prob- 
lems that will eventually influence public policy or legislation. Long-term 
stability and consistency of a state's assessment program and procedures are 
essenticJ to ^^uch inferences. 

The Tnedia, arid the public, Ccmmuni eating school performance data to the 
general public is a challenging task for the educational evaluator. The key 
to success is making the findings understandable to the journalists who must 
report such information in the newspapers and on radio and television. Re- 
porting of average percent correct for a content area, which provides only 
relative information and varies in level from one content area to another, is 
especially troublesome because the audience has to keep in mind that th« 
scales are not comparable. A much better practice is to employ scale scor- 
ing, defining a scale with a common origin and unit for all subject matter 
areas and employing it uniformly until its characteristics become well-known. 
Comparisons between schools or groups of students can then be expressed in 
familiar numbers, and year-to-year gains or declines in student performance 
can be followed in units that have a widely understood meaning. Certain 
achievement scales, such as that used to report Scholastic Aptitude Test 
(SAT) scores, have achieved this status. 

An even more comprehensible form of reporting, how"ever, is to state 
the percent of students who fall above or below certain thresholds on the 
attai-^ment scale> If these points correspond to administrative cutting points 
( f^.g., for graduation, special honors, admission to college, etc.) their practical 
impiL-^tion is entirely clear. If these objective criteria do not exist, the item 
content typical of selected score levels can be exhibited to convey the nature 
of the tasks that students at these levels can typically perform. The NAEP 
reading scale, for example, is characterized for reporting purposes by displays 
of items that students at the 150, 200, 250, 300 and 350 points on the scede 
have an SO percent chance of answering correctly. 

Another possibility is to take a normative approach and to designate cer- 
tain arbitrary percentile points in the population of students. The 25, 50 
and 76 percent points, for example, might be referred to as the ^^basic," "in- 
termediate," and "advanced" mastery levels. In this connection, however, tt 
must be mentioned that achievement testing and assessment are quite dif- 
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ferent when it comes to estimating the percent of students above a specified 
performance threshold. In achievement data, it is a simple matter to obtain 
these percentages by enumerating students whose individual bcores fall m 
the denned intervals. But from matrix sampled assessment data, individ- 
ual scores a:^ not- avdilable. and the percent of students above some point 
pn tbe-scale ofwhe group means can be estim.ated only if the distribution 
of proSciencies vvithin the group can be described. Up to novx', the infor- 
mation necessar^v to estimate these vvithin-group distributions has not been 
part of assessm^ent results; it has had to come separately &om conventional 
achievement tests rather than matrix sampled assessm^ent designs. One of 
the main strengths of the duplex design is that the proportions of students 
exceeding specified mastery levels can be estimated in the sam.e manner as 
in achievement testing. This enables percents of students at specified levefe 
to be estimated directly. 

Educational research specialists. A constituency independent of school sys- 
tems, yet having an interest in the information generated by state tec^ting 
programs, consists of academic and professional research workers engaged in 
study of e due at ion and the schools. In principle, they can use information 
from either achievement testing or assessment. But like the curriculum spe- 
aalists, they are aJso often interested in detailed area? of attainment, not just 
one broad skill areas measured by individual achievement t'^^sts. The data 
from assessment programs may be more relevant to them t^an traditional 
test scores. Ass^sment data will also typically have higher generalizabilit^r 
indices, and thus clearer relationships with other variables. ^ 

The effect of matrix sampling on generalizability is demonstrated by the 
estimated correlation coefficients shown in Table 1. The data are reading 
score means in Califomia schools measured in two successive years. .tOtice 
that the sizes of the correlations increase (the school means become more 
accurate) as the sizes of the samples of students increase from row 1 to row 
3. Similarly, the correlations increase when student sample size remains fixed, 
but the numbers of items sam.pled increase from S5 in a single test form, to 
12S in 16 forms, to 400 in 40 forme. This latter effect arises from the increased 
generalizability due to item sampling. It would be even more pronounced if 
different items were sampled each year. It would then maxim.ally suppress 
the effects oHtem heterogeneity that attenuate relationships between student 
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TABLE 1 



Effect of sampling of students and sampling of items on 
the year-to-year correlations of sixth grade mean reading 
attainment scores of California schools 

Number of items in matrix sample 







So 


128 


400 


Number of students 


50 


.59 


.73 


.79 


sampled 


100 


.67 


.78 


.88 


per grade 


200 


.76 


.81 


.93 



attainment and the background variables. 

Because most standard computer packages require scores for individual 
respondents, matrix sampled assessment data can present something of a 
dilemma to research workers. Only more advanced investigators currently 
know how to use matrix sampled data directly by hierarchical methods; (see 
Mislevy, 19S5). Until computer packages become available for these methods 
of analyzing scores that exist only at the group level, the data obtained from 
matrix sampling designs will not be convenient for secondary analysis. In this 
respect, the duplex design proposed in this paper has a marked advajitage: 
it supports scoring of the item response data at both the individual and the 
group level. ReseWch workers can thus make use of either of thesjs types of- 
data depending on their statistical expertise. % 

2. Uses of attainment information 

9 

The uses of information on student attainment identified above can be 
classified in terms of the decision-making activities supported. 

Guidance: counseling, placement, promotion, and certification of indi- 
vidual students. Each of these uses accurate test scores in at hejst the main 
areas of proficiency and subject matter in the curriculum. Standardized 
achievement testing is a main source of this information. 

Evalnation: choosing among competing curricula, instructional programs, 
or educational materials. These choices require information on the /crfor- 
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mance levels of groups of students pursuing alternative programs or using 
different materials. Matrbc-sampHng assessment, mailing miairnal demands 
on student testing time, provides this type of information at the group level, 
but scores for indi'ddual students are not available by this method. 

Mcncjen}eni: -morJtcring student attainment in programs, schools, and 
^scho^I^ystems-^Ianagerial decisions can utilize m.ea^ures of attainm^ent at 
the classroom or school level. They need much the same level of detail as 
e\-aIuation studies. Resistance to teaching-to-the test is \-ital in this use. This 
information need is better served by assessment methods than by individual 
student achievement testing. 

P olicy: judging the overall progress of an educational syste.n, or its main 
components, for purposes of formulating legislation and allocating resources. 
Policy decisions can utilize statistics of attainment aggregated to the districtT 
or state level. They do not require the level of detail needed In program 
evaluatic i or school manageme..t. The required information can be obtained 
equally well by achievement testing or by assessment results summarized in 
I road areas of proficiencies or subject matter. 

Research: secondary studies of the conditions and background variables 
that influence student attainment. Statistical methods In educational re- 
search typically depend upon accurate scores for Individual students. The 
existence of widely used, well-defined scales for reporting results greatly fa- 
cilitates such studies. Student achievement testing based on standardised 
measures hai, traditionally served this purpose. , 

3. Combining student achievement testing a^J assess- 
ment of curricular objectives 

It should be cleax from the preceding discussion that traditional indi- 
vidual achievement testing differs In Important ways from assessment of thr, 
success of schools or programs In attaining specific curricular objectives. Up 
to now, these two types of educational measurement have been conducted 
ir separate testing programs using different instruments. Because the item 
content of these instruments is much the same, however, substantial dupli- 
cation of cost, effort, and demand on classroom time is incurred to obtain 
the same information In different forms. 

We suggest that with a suitably designed assessment instrument, both of 
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these forms of information can be obtained in a single test administration re- 
quiring no more classroom time than conventional achievement testing. The 
instrument -;ve propose for this purpose, which \\e call a "duplex design 
has multiple stratiSed random test forms like those used in assessment. The 
items are as5;^ed-to forms in such a v^-ay that a student's response to a par- 
Jticulsj-form caa^be scored in broad skill and content areas, while responses 
over foims can be aggregated to provide scores for detailed curricular ob- 
jectives at the school or other group level. An example of the layout of an 
Instrument of this type In eighth grade mathem.atics Is sho'^m in Table 2. 

The design In Table 2 is based on the assumption that m.athematics at- 
tainment is expressed in three broad categories of behavior, called "profi- 
ciencies". These proficiencies are derived from cog- 'live distinctions between 
procedural knowledge, semantic knowledge, and problem solving. The math'^ 
ematicai substance of the proficiencies is clcissified in the content categories 
of the discipline as reflected in current curricula and textbooks at this grade 
level. Scores for individual students can be calculated within forms in three 
ways. First, scores for each of the three proficiencies are obtained by aggre- 
gating over content. Second, diagnostic scores in the main content categories 
(Numbers, Algebra, Geometry, Measurement, and Probability & Statistics) 
are obtained by aggregating over the proficiencies and over the subtopics 
within the main content categories. Third, an overall score for mathematics 
is computed by aggregating over all items. 

At the same {ime, scores for schools or other groups of students can be 
calculated for e^ch of the 57 elements in the table bv a^^e^atincr over test 
forms. When the scoring methods described in Mislevy Bock (1987) are 
used for this purpose, the mean of the proficiency or of the contont area 
scores of students In a given school will equal the mean of the school-level 
content-element scores within that proficiency. Thus, the several types of 
information extracted from the duplex design are expressed on the same 
scale of measurement. 

Depending on the itemx pool, not all of the curricular elements m?.y be 
included when the design is implemented. In a prototype of the grade S math- 
em^atics design based on items from the California and Illinois Assessments, 
conterit categories 15 (irrationals), 23 (inequalities), and 44 (other systems 
of measurement), 52 (experim.ents and surveys) were not represented. In the 
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TABLE 2 

A GP^A^DE 8 MATHEMATICS DUPLEX DESIGN 



Proficieiides 



CccLtent Categories a. Prccedural b. Kr^ovvledge c. Higher 
^ Skills^ of Facts t Level 
Concepts ^ Thinking^ 



10. 


NuTTibers 










Integers 


11a 


lib 


11c 




Fractiors 


12a 


i2b 


12c 




Percent 


13a 


13b 


13c 




Decimals 


14a 


14b 


14c 




Irrationals 


15 a 


- — T 

iOO 


15'-. 


20. 


Algebra 










Expressions 


■ 21a 


2 lb 


21c 




Equations 


22a 


22b 


22c 




Inequalities 


23a 


23b 


23c 




Functions 


24a 


24b 


24c 


30. 


Geometry 










Figures 


?]i 


31b 


31c 




Relations h Transformations 




32b 






Coordinates 




33b 


33€ 


4C. 


Measureriieni 




t 






English h metric units 


41a 


41b - - 


4ic 




Length, area Ic volume 


4?3, 


42b " 


42c 




Angular measure 


43a 


43b 






Other -systems (time, etc.) 


44a 


44 b 


44c 


50. 


Fro^ability & Staiisiics 










Probability 


0 i o 


51b 


51c 




Experiments surveys 


52a 




52c 




Descriptive Statistics 


5:a 


53 b 


53c 



^Calculating, rewriting, constructing, estimating, executii ^' algorithms, 

*Terms, definitions, concepts, principles. 

^Proof, reasoning, problem solving, real- world application:. 
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protot}-pe instrument, these elements were replicated in 24 booklets contain- 
ing a total of lOSO items. The item^ in any given form were chosen randomly 
from the pools representing each of the currlcular elements. 

In the administration of this type of instrument, the booklets are dis- 
tributed in rf)tation vrithin classrooms. The fact that difterent students may 
J>e responding to- different forms and items does not typically present any 
difnculty. This method of test administration has been used widely in as- 
sessment programs with good success. In paiticvJar, the experience of the 
CaU lornia Assessment shows that, when expendable test forms are used, 
group testing with this type of instrument can be carried out as early as the 
third grade. 

4. The contribution of modern item response theor^t 
(IRT) 

Efficient estimation of comparable scores for all students, regardless of 
which test form they are assigned, requires the use of modern IRT methods 
of item scaling. Because the item content of each of the scales is perfectly 
balanced in the duplex design, the scoring is robust in the presence of minor 
departures from the conditional independence assumed in conventional IRT 
m^ethods. In the implementation of these methods, the instrument is ad- 
ministerec;! initially to a probability sample of students at the selected grade 
level. The test items are then calibrated, preferably by the marginaf maxi- 
mum likelihood method (Bock and Aitkin, 19S1), with the unit and origm of 
measurement chosen so that the mean and standard deviation in the popula- 
tion of students is the same for all scales in the base year. The resulting item 
parameters are then used to compute students' scores by maximum iikelihood 
or Bayes methods, and each score is accompanied by a standard error or pos- 
terior standard deviation. Scores computed in succeeding years with these 
item parameters have constant origin and unit and are suitable for measuring 
growth anu change in the population from the base year onward. Becri.use 
IRT m.ethods are used, it is possible to add and retire items from the test 
without altering the initial definition of the scale. This updating can be done 
as part of the operational administration of the test without additional field 
trials. New developments in item response theory also account for eftects of 
so called "item-parameter drift" while retaining the original scale definition 
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(Bock and Muraki; 19S6). This armamentarium of IRT techmques. along 
vath provisions for ^^Ti^ing and critiquing new items, constitutes the item 
m^ainienance system that supports the comprehensive assessm.ent program. 

Scores for schools or other groups of students can be estimated by IRT 
methods us:r,g the models for group data described by Misle^y (19S4). These 
jnethpds provi da -scores for the cuiricular elements on the assumption that 
each pupil responds to one item from each elem^ent. The duplex design 
satisfies this condition. This type of scoring is especially easy to carry out 
because it uses, as statistics, the number of students who attempt each item 
within the classroom school and, among those, the number who respond 
correctly. Thus, the calculations require only a classroom or school summary 
file rather than the much larger file of individual item responses required for 
the scoring of students in the skill areas. 

5. Adaptive testing 

With the aid of IRT scoring methods, it is possible to minimize test- 
ing time by using some form of adaptive test administration. Ideally, one 
would prefer individual, fully adaptive, computerized test administration in 
w^hich each item presented to the examinee is most informative, given the 
provisional estimate of the; examinee's proficiency. But almost equal gains in 
efficiency^can be obtained by group-administered, twc-stage testing (L9rd, 
19S0). In this form of testing, each student takes a short pre^-test of general 
knowledge in the subject matter area. This pre-test is then scored by the 
teacher prior to the main test, and the student is assigned th^ appropriate 
second-stage form according to the result. A feasibility trial of a two-stage 
form of the duplex design for eighth-grade mathematics described above is 
presently being conducted in Illinois and California as a project of the OFRI 
Center for Student Testing, Evaluation and Standards. The assessment, in- 
strument for this study consists of a 12-item pretest and S second-stage forms 
at < ?.ch of three levels of difnculty — easy, interm.ediate and hard. At the stu- 
dent level, th^ instrum.ent tests three mathematics proficiencies and five main 
content areas, and at the classroom and school level, 45 distinct curricular 
elem.ents. A report of this study is in preparation (Bock, et ah, 19S7). 

6. Reporting 
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To be most broadly useful, a compreheusive assessment should produce 
reports for a variety of audiences. Computer generated reports, with ex- 
planatory comments, should be supplied to students, classroom teachers, 
school department heads and principals, district supervisors, the state de- 
oarcij.eni: of edui;at.ion. and the m.edia. Possible content and reporting forms 
for this purpose are suggested in this section and illustrated for the duplex 
design in Table 2. The results shown are taken from, the Illinois field trial of 
the duplex design in eighth grade mathematics. The names of the student, 
teacher, and school have been changed. 

Students. A report to individual students, to be shared with their parents, 
and a similar copy supplied to the student's classroom teacher, might take, 
the form shown in Figure 1. The student's profile of scale-scores in the main 
skill and content areas is presented both graphically and numerically. In the 
graph, the score value is represented by a small diamond bracketed by a 66% 
confidence interval on the true score. The numerical value of the score is also 
shown at the right. The heavy vertical line represents the student's overall 
mathematics score. 

The ori?;in and unit of the scale scores are assigned in the first year of 
the assessment and remain fixed thereafter. In Figure 1, a scale similar to 
that used^by the California Assessment Program and by NAEP is shown: 
the mean for the state is set at 250 and the standard deviation at 5(T. The 
range of the scale is 0 to 500. 

To aid in the normative interpretation of the scale, percentile points of 
various score distributions are shown for selected points on the scale. The 
student reports include percentiles for the classroom to which the student is 
assigned, for the school, and for the state or higher level population. Per- 
centiles for the state are the same on all forms and can be printed beforehand; 
those for the school and classroom are overprinted by computer along with 
the information pertaining to the particular student. 

In addition, the scale is criterion-referenced to certain mastery levels de- 
fined by test items having thresholds near these points. In the displrys 
shown here, three mastery levels are distinguished: basic, iniermediaie and 
advanced. The implication is that students who fall in the basic range are 
candidates for some form of additional instruction or remediation, those in 
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the intermediate range are progressing at the normal pace, and those in 
the advanced range should be given opportunities for special instruction or 
activities in the relevant subject matter. 

The deviation of the students confidence inter/als about the heavy verti- 
cal line to the right indicates areas of relative strength, and to the left, areas 
^of relative VN-ealijess. In the display of a student sho\ving uniform progress, 
(not requiring additional work in any skill or topic), all conndence intervals 
would overlap the vertical line. 

Schools. The reports intended for the district superintendents and school 
principals take the two form.s shown in Figure 2. The first form, shown in Fig- 
ure 2A, summarizes the proficiency and content scores of all students at the 
grade level. The distributions of student scores are depicted as histograms, 
and the percent of students at each mastery level is shown. The school meah 
for each skill and topic is shown at the right along with the corresponding 
state percentile. The percentile refers here to the state-wide distribution of 
school means and not to the distribution of individual student scores. Each 
percentile shows the ranking of the mean of this particular school among the 
means of all schools in the state. The heavy vertical line represents the over- 
all mathematics mean score for the school; it is also expressed as a percentile 
of the state-wide distribution of school means. 

The second form of the school report, shown as Figures 2B and 2C, 
summarizes the school scores for each of the 45 cuirricular elements covered 
in the duplex design. The school level score for each element is marlced by 
a diamond, and'-the corresponding horizontal bar is the plus-or-minus one 
standard error confidence interval on the school true score. N.of'e that the 
confidence intervals are shorter than those for mdividual students because of 
the greater stability of srhool level scores. The range of the scale can also 
be shorter because the variation between schools is less than that between 
students. 

Emulating the reports of the California Assessment Program, the school 
report also includes a rectangular box or "comparison band" for each curric- 
ular element. The band represents the range of scale scores for the element 
that would be expected on the basis of the resources and community back- 
ground of the school. The length of the confidence band allows for both the 
prediction error and the measurement error of the respective clement scores. 
From data for the state as a whole, relationships are empirically determined 
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to best predict the performance of the school from measures of economic 
and social characteristics of the school district. These relationships give a 
range of scores that would reasonably be expected from knov>-Iedge of the 
characteristics alone. They permit the performance of the reported school 
to be compa5§d wkh that of other schools similar chaxacteriscics. K the 
^calewseore of th^ school lies to the right of this band, then the effectiveness 
of Its Instruction for the curricular element Is better than might have been 
expected. If the scale score falls to the left of the comparison band, the 
effectiveness of the school's instruction In the curricular element is 'poorer 
than might have been expected. These comparisons reveal relative strengths 
and weaknesses in the school's Instructional program. 

State. rc\ state-level summaries of student and school performance, the dIs*-»^ 
plays in FIgvjres 3A and 3B are informative and easily understood by the 
general public. The state-level information Is summarized In terms of over- 
all mathematics achievement rather than scores for proficiencies, content, or 
curricular elements. Fi gurc 3 A shows the estimated distribution of overall 
mathematics scores for all students In the state. Data for the current year 
and the previous year are presented in order to show the directicii of change. 
Both the state's scale score and the corresponding national percentile are 
presented. The 1985 data and the national percentile In Figure 3A are hy- 
pothetical; the 19S6 data are based on the Illinois field trial. The median 
score of students Jn the state Is shown as a heavy line, and^the percent of 
students In eachW the mastery levels is also given. The graphs convey both, 
the numbers and the percent of students who are achieving IrCelghth grade 
mathematics at recognized levels of mastciy This Is the form of data that 
Is of most interest to state ofnclals, legislators, and public. 

Graphical presentations similar to ^'Igure 3B, which shows here the ab- 
solute and relative overall mathematics performance of the 32 schools in the 
Illinois field trial, would be of special interest to state departments of edu- 
cation and the media. By the use of code numbers, the display shows the 
mathematics achievement scale score for each school relative to the score that 
would be predicted on the baisis of the school's characteristics and resources. 
It is apparent from Figure 3B that these predictions are relatively accurate 
in the Illinois data. The middle diagonal black line on the graph shows the 
expected score, and the vertical distance of a school's location from that 
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line indicate 'ative performance. If this distance is greater than the 97.5 
percent bounu. mdicated by the upper diagoneJ line, the school is performing 
better than expected from community characteristics, if it is below the 2.5 
percent bound indicated by the lower diagonal line, the school is perform- 
mg more poorly than would be expected on these grounds. On this graph, 
^anyq^ie privileged to view the key to the school codes could see immediately 
those schools that are relatively more effective in teaching eighth-grade math- 
ematics, and those that are relatively less effective. The chart is a basis for 
addressing the accountability of schools for the attainment of their students 
in this subject matter. 

Media. Any of the foregoing reports from the school level upward could be 
released to the media. A considerable amount of descriptive material and 
comment may have to accompany the quantitative reports in order ♦'o make 
them understandable to reporters and the public. As an aid to interpretation 
of the results, a good practice is to display actual items from the test. The 
pre-test items the two-stage testing serve this purpose admirably. Because 
of the high level of exposure of these items, they would be r3placed annually 
and thus will be available for release to the public immediately following 
the testing. Having been chosen from among items of high discriminating 
power and covering a wide range of general mathematics proficiency, they 
are atmong the most powerful indicators of overall attainment in the subject 
matter. The locations of their thresholds on the scale score^continuum can 
be presented graphically as a means of content-referencing the scale. 

7. Between-state comparisons 

The utility of state assessments can be further enhanced by expressing 
the results in terms of a common scale, preferably one for which national 
norms exist. State can then be compared with state, and state w'th nation, 
for purposes of eveiluatlng educational programs and promoting economic 
development. National norms could, of course, be obtained by administering 
the state test in a nation-v/lde sample of schools, but the prospect of all, or 
most, of the fifty states undertaking such surveys is not pleasant to contem- 
plate. By use of equating methods, a much more efficient and less intrusive 
approach is possible. All that is needed is to administer, to a sample of 
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students who have taken the state test, a nationally normed test covering 
approximately the same content as part or all of the assessment instrument. 
Statistical methods could then be used to obtain the best unbiased prediction 
of the national l^st scores from the scores on the state test. The predicted 
national test^scores could then be aggregated to the school district or state 
JeveUar purpos«-of comparing educational performance in one state with the 
national norm or with any other state using a similar procedure to express 
its assessment results. 

From the normative score distribution of the national test, the predicted 
scores could be interpreted in oerms of percentiles of the national population 
in the same way that the student scores sie interpreted in local and state 
percentiles. This method has already been used to express the reading com- 
prehension scale of the California Assessment Program in the units of tYit 
Degrees of Reading Power test at the eighth grade level (Bock, Sykes, and 
Schilling, 19S7). As a source of national test scales in terms of which state 
assessment results could be expressed, ^--he National Assessment of Educa- 
tional Progress is an obvious candidate, provided it could produce scores at 
the pupil level suitable for this purpose. 

8. Conclusions 

Our analysis of the potential users of data on educational outcomes — 
students, parents, teachers, school counselors, school administrators, l)oards 
and officials, curriculum experts, textbook writers, state legislators and de- 
petrtments of education, ai-d educational rest ch specialists^leads us to 
conclude that currently existing programs for evaluating educational pro- 
ductivity should, and can, be redesigned to serve the needs of this varied 
community. We propose *or this purpose the "duplex design", which supplies 
achievement scores for individual students in the main areas of proficiency 
and content while at the same time evaluating the progress of schools in at- 
taining the, detailed objectives of the instructional program and curriculum. 
Based on new developments in educational statistics and m.easurem.ent, in- 
cluding item-response theory, matrix sampling, and two-stage testing, the du- 
plex design is capable of delivering this range of information with no greater 
demand on testing resources aind classroom time than is now required in 
conventional every-pupil achievement testing. 
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Survey Test of Grade 8 Mathematics 

STUDENT REPORT 



Student: David Taylor 
Teacher: Mary Jones 
Class: MathSG 
School: Sanderson 
Date of Testing: December 12, 1986 



Your personal Math achievement profile 

♦ * Sjcale score profile and confidence intervals 



Profile Percentiles 
Score Class School State 



SKILLS 

Procedures 
Knowledge 
Problem Solving 

TOPICS 
Numbers 
Algebra 
Geometry 
Measurement 
Statistics 



299 


78 


70 


84 


328 


93 


90 


94 


325 


96 


89 


93 


311 


89 


76 


89 


277 


80 


70 


71 


376 


98 


99 


99 


290 


81 


65 


79 


258 


53 


44 


57 



Scale Score 

Mastery Level 

Overall math score 
Class Percentile 
Scliool Percentile 
State Percentile 



300 



— I — 
350 



~I — 
400 



450 



1 — \ r- 

50 100 150 200 250 

Baste ^ InUm. -4* — Advanced — *\ 

308 ± 19 
93 
87 
93 



EXPLANATION: 



Your scores for five areas of mathematics are shown in the graph above. 
Each bar on the graph has a 2/3 chance of including your true score. The 
diamonc* marks the best estimate of your true score. Scores toward the 
right hand side of the graph indicate relative strength in the mathematics 
skill or topic. Scores toward the left indicate relative weakness. Th^ 
heavy black verticle line marks your overall average score in mathematics. 
The overall math score, and the class, school, and state percentiles 
corresponding to it. are shown below the graph. 
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Survey Test of Grade 8 Mathematics 



SCHOOL REPORT 



School: Sanderson 

Dcte of Testing: December 12, 19S6 

Number of Students Tested: ^'^ 



School distribution 



School State 
Mean Percentile 



SKILLS 

ProGcduras " 



Knov;ledge 



Problem Solving 
TOPICS 



Numbers 



Akebra 



Geometry 



Measurement 



Statistics 



8% 



6?D 



p. 9 



6% 



P. f 



6% 



13% 



8% 



13% 



645 



65>t 



• • • 4 



65% 



66% 



• • • « 



62% 



54% 



67% 



63% 



A 



29% 



P. P. 9, 



29% 



28% 



31% 



)«w 



33% 



• [• • • 

• |A A «. . . 



277 



276 



277 



276 



278 



25% 



2<% 



275 



27^1 



264 



91 



94 



95 



93 



97 



95 



88 



84 



T 1 r 



T ""I 1 1 r 



Scale Score 
Mastery Level H 
Overall math score 
State Percentile 



50 100 150 200 250 300 350 400 450 



Basic 



-Iniermr^ Advanced ^ 

274 
94 



EXPLANATION: Each • represents about three students. The heavy black 
vertical line marks the overall average score of the school in 
mathematics. 
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Sanderson 

SCHOOL REPORT (page 2) 



School performance on curricular objectives 



Objective profile {o). confidence intervals (— o— ) 
and comparison bands ( t i ) 

Scale State Percent 

Score 55tile Correct 



1. NUMBERS 












Integers 

III vW^^WI 












Procedures 
Knowledge 


j — 

{ 




280 


y / 
98 


72 


Problem SoIvTnc: 






261 


78 




c - * * ^ 

rrsctions 












Prnc^dii TPS 
Knowledp's 

\ 1 1 \t/ TV 1 ^ Vl^w 

Problem Solving 




■ 1 


318 
262 
292 


97 
82 
95 


81 
58 
63 


Percent 












Prncpdu rps 
Knowledge 


t A— 1 

i 




250 
269 


71 
80 


53 
6i 


Problem Solving 






273 


79 


46 


Decimals 












Procedures 

1 1 \^ W W Vl W4 1 W V 

Knowledge 


1 — o— 


— <Ji— 


263 
296 


64 
98 


56 
79 


Problem Solving 


^^y^ 




258 


73 


67 


2. ALGEBRA 






Expressions 












Procedures 
Knowledge 


1 -r 




274 
246 


91 
48 


69 


Problem Solving 


1 1 




290 


100' 


* 58 


Equations 


\ 
V 










Procedures 
Knowledge 


1 - 

1 




275 - 
287 " 


-.80 
93 


49' 

58 


Problem Solving 






285 


99 


5S 


Functions 












Procedures 






260 


99 


53 


Knowledge 


\ - 




281 


93 


38 


Problem Solving 


1 




285 


95 


64 



T 1 5 1 r 



Scale Score 150 TOO 250 300 350 

Overall math score 274 

Procedures: Calculating, rev/riting. constructing, estimating. 
Knowledge: Terms, uefinitions. concepts, principles. 
Problem Solving: Proof, reasoning, real-world applications. 
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SCHOOL REPORT (page 3) 
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Objective profile (o), confidence intervals (• 
and comparison bands (I ' 



3. GEOMETRY 

Figures 

Procedures 

Knov/ledge 

Problem Solving 
Relations ic transformations 

Procedures ,^ 

JKno\atledge 

Problem Solving 
Coordinates 

Procedures 

Knowledge 

Problem Solving 

4. MEASUREMENT 



me 



English Sc metric urjits 
Procedures 
Knowledge 
Problem Solving 

Length, area ic volu 
Procedures 
Knowledge 
Problem Solving 

Angular measure 
Procedures 
Knowledge 
Problem Solving 
STATISTICS 

Probability 
Procedures 
Knowledp^e 
Problem Solving 

Descriptive statisticjs 
Procedures 
Knowledge 
Problem Solving 
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Scale Score 
Overall math score 



150 



200 



I 

250 



II3>' 



I 

300 



Scale 
Score 



State 
%tUe 



258 
264 
264 



69 
73 
80 



269 
288 
286 



288 
291 
293 



95 
84 
96 



89 
94 
98 



270 
262 
268 



267 
287 
283 



253 
279 
258 



91 
78 
81 



70 
100 
95 



74 

89' 

70 



r 
350 



274 
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Percent 
Correct 



262 


69 


44 


262 


50 


58 


274 


95 


51 


258 


66 


43 


281 


81 


60 


268 


84 


63 



'STATE SUMMARY 

Mathematics scores of 8th Grade Students 
in 1985 and 1986 



1985 



1986 



14% 



I . 



83% 



3% 



m m 



H ? ■ H H 



7% 



83% 



Scale Score \ 

V 

National PercentiL 
Mastery Level 



100 



1 — 

150 

5 

Basic • 



200 
15 



10% 



=3^ 

H ■ H 1 



250^ 
55 



300 



83 



Intermediate' 



, 350 400 

95 99 
Aiianced—^ 



EXPLANATION: 

Overall mathematics attainment of 8tfi grade students in Decem- 
ber of 1985 and 1986. Each box ( represents 1000 students. 
The heavy line { I ) is the median score for each year. 
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'STATE SUMMARY 

School Performance Chart 
8th Grade Mathematics 



270- 



260- 



Observed 
scale 
score 

for 

school 



250 



240- 



230- 



220- 



210- 



High Relative 




/25/ / 

X 10 &h / 






— .»» 

* Ptrformance 




High 

Performance 




08 30/" 




Average 






/ 19 

16 . . 


Performance 
•% 








Low 


1 1 


1 — r 


Low Relative 
Performance 

r T 1 ' 


Performance 



210 220 230 240 250 260 270 280 

Scak score expected for school based on commurrity 
characteristics and resources. 

EXPLANATION: 

The location of schools on the performance chart is indicated by their identi- 
fication codes. Ah$oi\:te performance levels are given by the positions of the 
schools on the scale o? the left. Performance relative to other schools v/ith 
the same community characteristics and resources is indicated by the vertical 
distance of the school code from the heavy diagonal line. Schools located above 
the upper light diagonal line are performing better than expected. Those belovy 
the lower light diagonal line are performing fess v/ell than expected. 
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II. Sample Score Reports from the Illinois Tryout 
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-Survey Test of Grade 8 Mathematics 

STUDENT REPORT 



Student: Eric Jones 
Teacher: Mr. Rivera 
Class: 9:10 

School: Hamilton Jr. High 
Date of Testing: 11-20-86 



Your personal Math achievement profile 



Scale score profile and confidence intervals 

Profile P«rcent:i«s 
Score Class School Statt 



SKILLS 
Procedures 
Knowledge 
Problem Solving 

TOPICS 
Numbers 
Algebra 
Geometry 
Measurement 
Statistics 




213 


36 


23 


23 


215 


28 


23 


24 


246 


64 


47 


.47 


208 


21 


19 


20 


235 


62 


38 


38 


228 


39 


34 


33 


232 


51 


38 


36 


269 


76 


71 


65 



Scale Score 

Mastery Level 

Overall math score 
Class Percentile 
School Percentile 
State Percentile 



I 1 1 1 r 

50 100 150 200 250 JOO 350 400 450 

1^ Basic •^Ordinary-^ — Advanced 

231 ± 22 
45 
32 
31 



EXPLANATION: 



Your scores for five areas of mathematics are shown in the graph above. 
Each bar on the graph has a 2/3 chance of including your true score. The 
diamond marks the best estimate of your true score. Scores toward the 
right hand side of the graph indicate relative strength in the mathematics 
skill or topic. Scores toward the left indicate relative weakness. The 
heavy black verticle line marks your overall average score in mathematics. 
The overall math score, and the class, school, and state percentiles 
corresponding to it. are shown below the graph. 
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•Survey Test of Grade 8 Mathematics 

STUDENT REPORT 



Student: Robert Cobden 
Teacher: Mr. Rivera 
Class: 9:55 

School: Hamilton Jr. High 
Date of Testing: 11-20-86 



Your personal Math achievement profile 



Scale score profile and confidence intervals 

Profile Percentiles 
Score Class School State 



SKILLS 
Procedures 
Knowledge 
Problem Solving 

TOPICS 
Numbers 
Algebra 
Geometry 
Measurement 
Statistics 



1 1 1 1 1 r- 

50 100 150 200 250 300 

1^ Basic •^^Ordinary 

194 ± 19 
8 
8 
8 



198 


20 


15 


15 


170 


6 


4 


5 


202 


18 


16 


.17 


181 


12 


8 


9 


235 


41 


39 


38 


158 


4 


4 


3 


243 


65 


46 


44 


168 


6 


7 


5 



"T 



T 



Scale Score 

^^astery Level 

Overall math score 
Class Percentile 
School Percentile 
State Percentile 



350 400 450 
Advanced 



EXPLANATION: 



Your scores for five areas of mathematics are shown in the graph above. 
Each bar on the graph has a 2/3 chance of including your true score. The 
diamond marks the best estimate of your true score. Scores toward the 
right hand side of the graph indicate relative strength in the mathematics 
skill or topic. Scores toward the left indicate relative weakness. The 
heavy b'j^ck verticle line marks your overall average score in mathematics. 
The overall math score, and the class, school, and state |;srcentiles 
corresponding to it. are shown below the graph. 
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•Survey Test of Grade 8 Mathematics 



STUDENT REPORT 



Student: Laura Williams 
Teacher: Thomas Tucker 
Class: 9:55 

School: Hamilton Jr. High 
Date of Testing: 11-20-86 



Your personal Math achievement profile 









Profile 
Score 


Percentiles 
Class School 


Stat* 


SKILLS 














Procedures 
Knowledge 
Problem Solving 






262 
228 
274 


88 
43 
80 


61 
32 
69 


60 
33 
.68 


TOPICS 














Numbers 

Algebra 

Geometry 

Measurement 

Statistics 






259 
274 
336 
181 
284 


77 
69 
99 
14 
83 


55 
70 
94 
9 
80 


57 
68 
96 
8 
75 



Scale Score 

Mastery Level 

Overall math "score 
Class Percentile 
School Percentile 
State Percentile 



50 



100 150 
— Basic — 



"1 1 1 r 

200 250 300 350 400 450 

-^Ordinary-^ — Advanced — 
262 ± 18 
83 
64 
62 



EXPLANATION: 



Your scores for fiv€ areas of mathematics are shown in the graph above. 
Each bar on the graph has a 2/3 chance of including your true score. The 
diamond marks the best estimate of your true score. Scores toward the 
right hand side of the graph indicate relative strength in the mathematics 
skill or topic. Scores toward the left indicate relative weakness. The 
heavy black verticle line marks your overall average score in mathematics. 
The overall math score, and the class, school, and state percentiles 
corresponding to it. are shown below the graph. 
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-Survey Test of Grade 8 Mathematics 
STUDENT REPORT Student: Steve Marcus 

Teacher: Cindy Caldwell 
Class: 10:40 
School: Hamilton Jr. High 
Date of Testing: n-20-86 



Your personal M^th achievement profile 



Scale score profile and confidence intervals 

Profile Percentiles 
Score Class School State 



SKILLS 


1 1 
1 1 












Procedures 


1 1 




326 


73 


95 


94 


Knowledge 


1 1 




285 


43 


77 


76 


Froblerr. Solving 


1 1 
1 1 




346 


85 


97 


.97 


TOPICS 


1 1 










Numbers 


1 1 
1 ft 




313 


74 


88 


90 


Algebra 


1 ^ 




318 


78 


92 


91 


Geometry 


1 1 

1 — q- 




301 


52 


82 


85 


Measurement 






302 


55 


87 


85 


Statistics 


1 _4 




319 


78 


94 


92 



Scale Score 50 
Mastery Level 
Overall mathlscore 
Class Percentile 
School Percentile 
State Percentile 



100 150 200 250 300 350 400 450 

— Basic *\*-Ord{nary-^ — Advanced — •{ 

3U 17 
76 
95 
95 



EXPLANATION: 



Your scores for five areas of mathematics are shown in the graph above. 
Each bar on the graph has a 2/3 chance of including your true score. The 
diamond marks the best estimate of your true score. Scores toward the 
right hand side of the graph indicate relative strength in the mathematics 
skill or topic. Scores toward the left indicate relative weakness. The 
heavy black verticio line marks your overall average score in mathematics. 
The overall math score, and the class, school, and state percentiles 
corresponding to it. are shown below the graph. 
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-Survey Test of Grade 8 Mathematics 

STUDENT REPORT student: Thomas Williams 

Teacher: John Wilson 
Class: 9:15 

School: Whitesboro Elem. 
Date of Testing: 11-11-86 



Your personal Math achievement profile 



Scale score profile and confidence intervals 

Profile Percentiles 
Score Class School State 



SKILLS 
Procedures 
Knowledge 
Problem Solving 

TOPICS 
Numbers 
Algebra 
Geometry 
Measurement 
Statistics 




198 


37 


31 


1 

15 


212 


57 


43 


22 


212 


56 


40 


.22 


262 


85 


80 


60 


256 


78 


71 


54 




:.8 


47 


28 


163 


11 


6 


4 


167 


16 


8 


5 



Scale Score 
Mastery Level |* 
Overcll math score 
Class Percentile % 
School Percentile 
State Percentile 



I 

50 



100 150 200 250 300 350 400 450 
— Basic •\^Ordinary-^ — Advanced — •{ 



211 ± 19 
51 
35 
16 



EXPLANATION: 



Your scores for five areas of mathematics are shown in the graph above. 
Each bar on the graph has a 2/3 chance of including your true score. The 
diamond marks the best estimate of your true score, f^ores toward the 
right hand side of the graph indicate relative strength in the mathematics 
skill or topic. Scores toward the left indicate relative weakness. The 
heavy black verticle line marks your overall average score in mathematics. 
The overall math score, and the class, school, and state percentiles 
corresponding to it, are shown below the graph. 
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-Survey Test of Grade 8 Mathematics 

STUDENT REPORT 



Student: James Hopper 
Teacher: Tom Barnes 
Class: 9:15 

School: Whitesboro Elem. 
Date of Testing: 11-11-86 



Your personal Math achievement profile 

Scale score profile and confidence intervals 









Profile 
Score 


Percentiles 
Class School 


State 


SKILLS 














Procedures 
Knowledge 
Problem Solving 






242 
263 
247 


81 
87 
79 


75 
86 
72 


43 
61 
.,48 


TOPICS 














Numbers 

Algebra 

Geometry 

Measurement 

Statistics 




— op4. 


283 
255 
200 
214 
264 


94 
73 
34 
43 
77 


90 
71 
28 
48 
83 


75 
54 
16 
24 
61 



Scale Score 

Mastery Level 

Overall math "score 
Class Percentile 
School Percentile 
State Percentile 



50 



-n r- 

100 150 
- Basic — 



"1 1 r 

200 250 300 350 400 450 

-^Ordinary-*\* — Advanced — *\ 
246 ± 18 
85 
80 
46 



EXPLANATION: 



Your scores for five areas of mathematics are shown in the graph above. 
Each t '.' on the graph has a 2/3 chance of including your true score. The 
dnmond marks the best estimate of your true sc re. Scores toward the 
right hand side of the graph indicate relative strengch in the mathematics 
:kill or topic. Scores to \jrd the left indicate relative weakness. The 
heavy black verticle line marks your overall average score in mathematics. 
The overall math sr and the class, school, and state percentiles 
corresponding to it, are shown below the graph. 
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■Survey Test of Grade 8 Mathematics 
STUDENT REPORT Student: Chris Stewart 

Teacher: Susan Smith 
Class: 9:15 

School: Whitesboro Elem. 
Date of Testing: 11-11-86 



Your personal Math achievement profile 



SKILLS 
Procedures 
Knowledge 
Problem Solving 

TOPICS 
Numbers 
Algebfc 
Geometry 
Measurement 
Statistics 



Scale Score 
Mastery Level \^ 
Overall math'score 
Class Percentile x 
School Percentile 
State Percentile 



1 

50 



~n — 
100 



T 



T" 



Profile 


Per 


:entlles 


Score 


Class 


School 


State 


204 


42 


36 


18 


224 


48 


55 


30 


223 


53 


50 


.29 


239 


68 


64 


41 


221 


43 


39 


28 


200 


34 


27 


16 


217 


45 


51 


25 


232 


40 


57 


36 



150 200 250 300 350 400 450 



■Basic *]*-Ordinary-*\* — Advanced — »j 

220 ± 18 
47 
47 
22 



EXPLANATION: 



Your scores for five areas of mathematics are shown in the graph above. 
Each bar on the graph has a 2/3 chance of including your true score. The 
diamond marks the best estimate of your true score. Scores toward the 
right hand side of the graph indicate relative strength in the mathematics 
skill or topic. Scores toward the left indicate relative weakness. The 
heavy black tide line marks your overall average score in mathematics. 
The overall math score, and the class, school, and state percentiles 
corresponding to it. are shown below the graph. 
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-Survey Test of Grade 8 Mathematics 
STUDENT REPORT Student: Susan Gray 



Teacher: John Wilson 
Class: 9:15 

School: Whitesboro Elem. 
Date of Testing: ini.86 



Your personal Math achievement profile 



Scale score profile and confidence intervals 

Profile Percentiles 
Score 'Ilass School State 



SKILLS 












Procedures - 




143 


1 


L 


2 


Knowledge 




232 


73 


63 


36 


Problem Solving 




239 


79 


65 


.41 


TOPICS 










Numbers 




187 


30 


22 


10 


Algebra 




259 


81 


74 


57 


Geometry 




189 


26 


19 


11 


Mp^s* -ent 




211 


52 


44 


22 


Stal j ij 1 


205 


46 


32 


18 



T i I ~i I I I I r 



Scale Sc 50 100 150 200 250 300 350 400 450 

Mastery Level h ^aji'c ^Oriincry-^— Advanced — •{ 

Overall math score 208 ± 19 

Class Percentile ^% 4P • 

School Percf,ntile 31 

State Percentile 14 ^ 

EXPLANATION: 

Your scores for five areas of mathematics are shov\/n in the graph above. 
Each bar on the graph has a 2/3 chance of including your true score. The 
diamond marks the best estimate of your true score. Scores toward the 
right hand side of the graph indicate relative strength in the mathematics 
skill or topic. Scores toward the left indicate, relative weakness. The 
heavy black vertick- line marks your overall average score in mathematics. 
The overall math score, and th^ class, school, and state percentiles 
corresponding to it. are shown below the graph. 
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'Survey Test of Grade 8 Mathematics 

STUDENT REPORT 



Student: Terry Jones 
Teacher: Bill Stevens 
Class: 9:13 
School: Sanderson 
Date of Testing: 11-11-86 



Your personal Math achievement profile 

Scale score profile and confidence intervals 



Profile P«rcentlles 
Score Class School State 



SKILLS 
Procedures 
Knowledge 
Problem Solving 

TOPICS 
Numbers 
Algebra 
Geometry 
Measurement 
Statistics 



50 




308 


78 


73 


88 


303 


83 


69 


85 


268 


50 


43 


.64 


282 


58 


54 


74 


282 


67 


53 


74 


269 


56 


46 


65 


329 


96 


88 


94 


252 


46 


41 


52 



Scale Score 

Mastery Level 

Overall math "score 
Class Percentile 
School Percentile 
State Percentile 



— I 1 — 

100 150 

— Basic — 



200 



— I — 
250 



300 



~i 1 r 

350 400 450 

Ordinary-^ — Advanced 
286 ± 17 
16 
61 
82 



EXPLANATION: 



Your scores for five areas of mathematics are shown in the graph above. 
Each bar on the graph has a 2/3 chance of including your true score. The 
diamond marks the best estimate of your true score. Scores toward the 
right hand side of the graph indicate relative strength in the mathematics 
skill or topic. Scores toward the left indicate relative weakness. The 
heavy black verticle line marks your overall average score in mathematics. 
The overall math score, and the class, school, and state percentiles 
corresponding to it, are shown below the graph. 
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Tit€ Cntvrsity of Ckxrago 



-Survey Test of Grade 8 Mathematics 
STUDENT REPORT Student: Steven Livingston 

Teacher: Martha Thomas 
Class: 8:22 
School: Sander on 
Date of Testing: 11-11-86 



Your personal Math achievement profile 



Scale score profile and confidence intervals 

Profile Percentltes 
Score Class School State 



SKILLS 
Procedures 
Knowledge 
Problem Solving 

TOPICS 
Numbers 
Algebra 
Geometry 
Measurement 
Statistics 



>■ 



305 


57 


71 


86 


357 


83 


93 


98 


275 


37 


48 


.69 


296 


54 


66 


82 


325 


67 


81 


93 


311 


59 


72 


89 


312 


67 


80 


89 


279 


54 


61 


72 



Scale Score 

Mastery Level 

Overall math score 
Class Percentile 
School Percentile 
State Percentile 



50 100 150 200 250 300 350 400 450 

f< Basic 9^0rdinary ♦j^ — Advanced 

307 ± 17 

63 

79 

93 



EXPLANATION: 



Your scores for five areas of mathematics are shown in the graph above. 
Each bar on the graph has a 2/3 chance of including your true score. The 
diamond marks the best estimate of your true score. Scores toward the 
.ight hand side of the graph indicate relative strength in the mathematics 
skill or topic. Scores toward the left indicate relative weakness. The 
heavy black verticle line marks your overall average score in mathematics. 
The overall math score, and the class, school, and state percentiles 
corresponding to it. are shown below the graph. 
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-Survey Test of Grade 8 Mathematics 

STUDENT REPORT 



Student: Bill Johnson 
Teacher: Mary White 
Class: 8:22 
School: Sanderson 
Date of Testing: 11-11-86 



Your personal Math achievement profile 

"Scale score profile and confidence intervals 









Proflle 
Scora 


Percentiles 
Class School 


Stata 


SKILLS 


1 
1 














Procedures 
Knowledge 
Problem Solving 


1 1 
1 1 

1 H- 




,346 
330 
298 


85 
69 
52 


92 
84 
66 


97 
94 
.83 


TOPICS 














Numbers 








271 
360 
349 
302 
322 


34 
85 
79 
60 
83 


45 
94 
88 
74 
87 


66 
99 
98 
85 
93 


Algebra 
Geometry 
Measurement 
Statistics 

























Scale Score 

Mastery Level 

Overall math score 
Class Percentile 
School Percentile 
State Percentile 



"I I i i i I 1 r 

50 100 150 200 250 300 350 400 450 

\^ Basic •{^Ordtnary-^ — Advanced 

322 ± 17 
74 
88 
97 



EXPLANATION: 



Your scores for five areas of mathematics are shown in the graph above. 
Each bar on the graph has a 2/3 chance of including your true score. The 
diamond marks the best estimate of your true score. Scores toward the 
right hand side of the graph indicate relative strength in the mathematics 
skill or topic. Scores toward the left indicate, relative weakness. The 
heavy black verticle line marks your overall average score in mathematics. 
The overall math score, and the class, school, and state percentiles 
corresponding to it. are shown below the graph. 
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•Survey Test of Grade 8 Mathematics 

STUDENT REPORT 



Student: Susan Jones 
Teacher: Bill Stevens 
Class: 9:13 
School: Sanderson 
Date of Testing: 11-11-86 



Your personal Math achievement profile 



Scale score profile and confidence intervals 

Profile Percentiles 
Score Class School State 



SKILLS 
Procedures 
Knowledge 
Problem Solving 

TOPICS 
Numbers 
Algebra 
Geometry 
Measurement 
Statistics 




28C 


57 


52 


72 


208 


14 


10 


20 


228 


16 


17 




243 


24 


24 


44 


239 


30 


24 


42 


171 


6 


5 


6 


286 


74 


62 


77 


262 


53 


48 


60 



Srale Score 

Mastery Level 

Overall math score 
Class Percentile 
School Percentile 
State Percentile 



50 



100 150 
— Basic — 



200 250 300 350 400 450 
--^Ordinary-^ — Advanced — •\ 
240 ± 18 

22 

20 

40 



EXPLANATION: 



Your scores fcr five areas of mathematics are shown in the graph above. 
Each bar on the graph hbs a 2/3 chance of including your true score. The 
diamond marks the best estimate of your true score. Scores toward the 
right hand side of the graph indicate relative strength in the mathematics 
skill or topic. Scores toward the left indicate, relative weakness. The 
heavy black verticle line marks your overall average score in mathematics. 
The overall math score, and the class, school, and state percentiles 
corresponding to it. are shown below the graph. 
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NORC The f/nhfssity of Chicago 



Survey Test of Grade 8 Mathematics 

SCHOOL REPORT 



School: Hamilton Jr. High 
Date of Testing: 11-20-86 
Number of Students Tested: 76 



School distribution 



School State 
Mean Percentile 



SKILLS 
Procedures 

Knowledge 

Problem Solving 
TOPICS 

Numbers 
Algebra 
Geometry 
Measurement 
Statistics 



18% j 

• • • 


69% j 13% 
• • 1 


248 


46 


13%^. . 1 

• 
• 


74% 1 13% 
• 1 


250 


50 


13% 1 

j • 
• • • 


75% 12% 
• 

> • • 
• • 


250 


50 


14% 1 

• • • • 


73% 1 13% 


252 


55 


14% I 

• 

■ • 
• • 

■ • • 


77% 9% 
• 

• • 

• • 

• • L 

.•••.)•. ^. 


249 


47 


14% 1 

• • 
• • • 


70% 1 16% 

• 1 
••I 


251 


51 


21% 

• • • • 


68% 11% 

• 1 

• • L 


t 

248 


45 

26 


16% 1 

• 

■ • 
• 

• • • 

f.t. 


72% 1 12% 
• • 


241 


1 1 1 1 


1 ! i 1 







Scale Score 50 100 150 200 250 300 350 400 450 
Mastery Level h Basic ^Oriinaryi-*^ Aivancti ^ 

Ovcrdll math score 249 
State Percentile 48 

EXPLANATION: Each • represents about three students. The heavy black 
vertical line marks the overall average score of the school in 
mathetiatics. 
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Hamilton Jr. High 



SCHOOL REPORT (page 2) 



School performance on curricular objectives 

Objective profile (o). confide nce intervals (■ 
and comparison bands (I 1) 



NUMBERS 
Integers 

Procedures 

Knowledge 

Problem Solving 
Fraction? * 

Procedures 

Knowledge 

P.'oblem Solving 
Percent 

Procedu/es 

Knowledge 

Problem Solving 
Decimals 

Procedures 

Knowledge 

Problem Solving 
ALGEBRA 
Expressions 

Procedures 

Knowledge 

Problem Solving 
Equations 

Procedures 

Knowledge 

Problem Solving 
Functions 

Procedures 

Knowledge 

Problem Solving 






Scale 
Score 



State 
%tile 



270 
255 
235 



256 
252 
265 



229 
224 
270 



252 
267 
240 



79 
76 
23 



50 
66 
67 



46 
15 
76 



47 
76 
38 



254 
242 
260 



257 
250 
230 



2:0 
236 
257 



65 
41 
67 



J54 
34 
16 



64 
16 
77 



Percent 
Correct 



58 
64 
54 



51 
57 
49 



43 
41 
50* 



55 
68 
59 



55 
39 
•43 



46- 

45 

38 



47 
25 
41 



Scale Score 
Overall math score 



150 



200 



300 



350 



Procedures: Calculating, rewriting, constructing, estimating. 
Knowledge: Terms, definitions, concepts, principles. 
Problem Solving: Proof, reasoning, rea.-world applications. 
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Hamilton Jr. High 



SCHOOL REPORT (page 3) 



Objective profile (o), confidence intervals {■ 
and comparison bands ( i \ ) 



3. GEOMETRY 

Figures 

Procedures 

Knowledge 

Problem Solving 
Relations transformations 

Procedures 

Knowledge 

Problem Solving 
Coordinates 

Procedures 

Knowledge 

Problem Solving 

4. MEASUREMENT 




me 



English metric urjits 
Procedures 
Knowledge 
Problem Solving 

Length, area &. volu 
Procedures 
Knowledge 
Problem Solving 

Angular measure 
Procedures 
Knowledge 
Problem Solving 
STATISTICS 

Probability 
Procedures 
Knowledge 
Problem Solving 

Descriptive statisticjs 
Procedures 
Knowledge 
Problem Solving 



Scale 
Score 



State 
%tile 



240 

246 
272 



40 
43 
90 



241 
260 
253 



55 
42 
51 



224 
270 
263 



17 
73 
66 



246 
248 
231 



80 
54 
17 



239 
232 
268 



27 
7 
79 



231 
262 
243* 



43 
G8 
36 



241 
267 
242 



10 
60 
29 



241 
267 
247 



18 
38 
35 



Percent 
Correct 



Scale Score 
Overall math scute 



1 

150 



200 



250 
249 



300 



350 



NORC The University of Chicago 
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I 



Survey Test of Grade 8 Mathematics 

SCHOOL REPORT 



School: Whitesboro Elem. 
Date of Testing: 11-1^86 
Number of Students Tested: 83 



SKILLS 
Procedures 

Knowledge 

Problem Solving 
TOPICS 

Numbers 

Algebra 

Geometry 

Measurement 

Statistics 



School distribution 



33% 



30%^. , 



29% 



34% 



20% 



27% 



34% 



28% 



I 

• : : 

• • • 



'I' 

I: 



I 

J 

:i: 



..J. 

I 

j: 
:i: 



I 

:i 



T 

J. 

:i: 

*i* 
• • 

1 1 



• • • !• 

• • • 



.n A A 



60% 



75% 



71% 



65% 



n .•. .•. .•. 



71% 



• • • 

A A 



School State 
Mean Percentile 



4% 



4% 



2% 



5% 



2% 



1% 



1% 



"I i 1 1 1 1 1 1 1 — 

50 100 150 200 250 300 350 400 450 

Basic 4*-0rdinary-4* Advanced 



217 



219 



223 



223 



233 



223 



216 



225 



12 



Scale Score 
Mastery Level H 
Overall math score 
State Percentile 



l^-Ordinary^ 
222 
4 



EXPLANATION: 



Each • represents about three students. The heavy black 
vertical line marks the overall average score of the school in 
mathematics. 
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Whitesboro Elera. 



SCHOOL REPORT (page 2) 

t 

School performance on curricular objectives 

Objective profile (o). confide nce i ntervals (• 
and comparison bands (1 1) 



1. NUMBERS 

Integers 
Procedures 
Knowledge 
Problem SolviVlg 

Fraction? ' 
Procedures 
Knowledge 
Problem Solving 

Percent 

Procedures 
Knowledge 
Problem Solving 

Decimals 
Procedures 
Knowledge 
Problem Solving 

2. ALGEBRA 

Expressions 
Procedures 
Knowledge 
Problem Solving 

Equations 
Procedures 
Knowledge 
Problem Solving 

Functions 
Procedures 
Knowledge 
Problem Solving 




Scale 
Score 



State 
%tile 



206 
210 
232 



203 
217 
219 



196 
229 
208 



223 
217 
219 



221 
214 
252 



219 
232 
227 



216 
240 
244 



3 
5 

18 



6 
9 
5 



13 
21 
8 



11 
6 
9 



12 
6 
42 



. 7 

10 
12 



26 
22 
48 



Percent 
Correct 



43 
54 
55 



31 
43 
37 



36 
42 
30* 



46 
53 
49 



42 
27 
*43 



39' 

45 

35 



45 
30 

40 



Scale Score 
Overall math score 



150 



I I 
200 250 
222 



300 



350 



Procedures: Calculating, rewriting, constructing, estimating. 
Knowledge: Terms, definitions, concepts, principles. 
Problem Solving: Proof, reasoning, real-world appli ions. 
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Whitesboro Elem. 



SCHOOL REPORT (pages) 



Objective profile (o). con fiden ce intervals ("~^^) 
and comparison bands (i 1) 



3. 



GEOMETRY 
Figures 

Procedures 
Knowledge 
Problem Solving 
Relations & transformations 
Procedures 
Knowledge 
Problem Solving 
Coordinates 
Procedures 
Knowledge 
Problem Solving 

4. MEASUREMENT 

English & metric ur|its 

Procedures 

Knowledge 

Problem Solving 
Length, area & volqme 

Procedures 

Knowledge 

Problem Solving 
Angular measure 

Procedures 

Knowledge 

Problem Solving 

5. STATISTICS 

Probability 

Procedures 

Knowledge 

Problem Solving 
Descriptive statisticjs 

Procedures 

Knowledge 

Problem Solving 



T 






Scale State 
Score %tile 



212 
211 
222 



8 
4 
8 



209 
228 
242 



211 
225 
225 



5 
5 
29 



8 
8 
5 



206 
205 
212 



212 
247 
220 



187 
215 
228 



6 
2 
3 



4 
35 
3 



4 
LI 



247 
225 
229 



233 
268 
226 



22 
3 
7 



6 
41 
4 



Percent 
Correct 



Scale Score 
Overall math score 



150 



200 250 
222 



300 



350 



NORCr/., University of Chicago 



ERIC 
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Survey Test of Grade 8 Mathematics 



SCHOOL REPORT 



School: Sanderson 
Date of Testing: 11-11-86 
Number of Students Tested: 72 



School distributio ; 



SKILLS 
Procedures 

Knowledge 

Problem Solving 
TOPICS 

Numbers 
Algebra 
Geometry 
Measurement 
Statistics 




64% 



• 4 



65% 



7% 



. A . . # 



13% 



13% 



0. P 



• • • « 

•.•.4 



4 



66% 



• • • < 



62% 



54% 



• • • « 

67% 



• • • 4 



63% 



"I r 



School State 
Mean Percentile 



1 r 





28% 










277 


91 




29% 






• 
• 
• 




276 


94 




29% 






• 




277 


95 




28% 










w / 0 






31% 










278 


97 




33% 






• 
• 




275 


95 




25% 






• 

p 


""""24%* 


9 

271 

■ ■ ■ • ^ 

264 


^88 _ 

84 









Scale Score 
Mastery Level h 
Overall math score 
State Percentile 



50 100 150 200 250 300 350 400 450 

Basic — 4* Ordinary-^ Advanced — 

274 
94 



EXPLANATION: Each ♦ represents about three students. The heavy black 
vertical line marks the overall average score of the school in 
mathematics. 
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Sanderson 



SCHOOL REPORT (pag. 2) 

School performance on curricular objectives 

Objective profile (o), confidence intervals (- 
and comparis n bands ( 1 1 ) 



1. NUMBERS 

Integers 
Procedures 
Knowledge 
Problem Solvfng 

Fraction? 
Procedures 
Knowledge 
Problem Solving 

Percent 
P'-ocedures 
Knowledge 
Problem Solving 

Decimals 
Procedures 
Kno . ledge 
Problciii Solving 

2. ALGEBRA 

Expressions 
Procedures 
Knowledge 
Problem Solving 

Equations 
Procedures 
Knowledge 
Problem Solving 

Functions 
Procedures 
Knowledge 
Problem Solving 



Scale Score ^'^ 
Overall math score 



I 3 



200 



— 1 — I — 

250 300 
274 



Scale 
Score 



State 
%tile 



296 
280 
261 



318 
262 
292 



250 
269 
273 



263 
296 
258 



97 
98 
78 



97 
82 
95 



71 
80 
79 



64 
98 
73 



274 
246 
290 



275 
287 - 
285 



260 
281 
285 



91 
48 
100 



80 
93 
99 



99 
93 
99 



350 



Procedures: Calculating, rewriting, constructing, estimating. 
Khowledge: Terms, definitions, concepts, principles. 
Problem Solving- I'roof, reasoning, real-world applications. 



Percent 
Correct 



64 
72 
60 



81 
58 
63 



53 
61 
46^ 



56 
79 
67 



69 
42 
•58 



49- 
58 

58 



53 
38 

64 
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Sanderson 



SCHOOL REPORT (page 3) 



Objective prc^He {<>). confidence intervals (■ 
and comparison bands (( i) 



^mations 



3. GEOMETRY 

Figures 

Procedures 
Knowledge 
Problem Solving 

Relations & transfo 
Procedures 
Knowlejlge 
Problem Solving 

Coordinates 
Procedures 
Knowledge 
Problem Solving 

4. MEASUREMENT 

English & metric urjits 
Procedures 
Knowledge 
Problem Solving 
ength. area & volqme 
Procedures 
Knowledge 
Problem Solving 

Angular measure 
Procedures 
Knowledge 
Problem Solving 

5. STATISTICS 

Probability 
Procedures 
Knowledge 
Problem Solving 

Descriptive statistiqs 
Procedures 
Knowledge 
Problem Solving 




Score 



state 
%tile 



258 
264 
264 



269 
288 
286 



288 
291 
293 



69 
73 
80 



95 
84 
96 



89 
94 
98 



270 
262 
268 



267 
287 
283 



253 
279 
25^ 



91 
78 
81 



70 
100 
95 



74 
89 
70 



262 
262 
274 



258 
281 
268 



69 
£0 
95 



66 
81 
84 



Percent 
Correct 



49 
49 
49 



54 
57 
39 



54 

51 
57 



54 
49 
40 



44 
54 
57 



43 
'50 
40 



44 
58 
51 



43 
60 
63 



Scale Score 
Overall math score 



150 



200 



250 300 
274 



350 



NORC The University of Chicago 
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'STATE SUMMARY 

Mathematics scores of 8th Grade Students 
in 1985 and 1986 



1.985 



1986 



14% 




■ 
m H 


83% 1 


3% 








i ■ « 








■ ■ ■ ■ 

■ ■■■ 


■ ■■■ 1 










■ ■■■ 
■■■■■■ 1 















7% 




83% 




10% 






■ ■ • 










■ ■■1 






























■ ■F 

■ ■■fli 








m 


■ ■■■1 

■ ■■■1 




■ 






■ ■■■1 

















100 



Scale Score 
National Percentile ^ 
Mastery Level h 



T 
150 

5 

Basic 



200 
15 



250 
55 



Ordinary 



300 350 4p0 
83 *95 99 
Advanced 



EXPLANATION: 

Overall mathematics attainment of 8th grade students in Decem- 
ber of 1985 and 1986. Each box ( ■ ) represents 1000 students. 
The heavy line ( I ) is the median score for each yea. 
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5TATE SUMMARY 

School Performance Chart 
8th Grade Mathematics 




210 220 230 240 250 260 270 '>80 



Scale score expected for school based on community 
characteristics and resources. 

EXPLANATION: 

The location of schools on the performance chart is indicated by tlieir identi- 
fication codes. Absolute performance levels are given by the positions of the 
schools on the scale on the left. Performance relative to other scnools with 
Lhe same community characteristics and resources is indicated by the vertical 
distance of the school code from the heavy diagonal line. Schools located above 
the upper light diagonal line are performing better than expected. Those below 
the lower light diagonal line are performing less well than expected. 
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III. Item Parameter Estimates 



ERIC 



69 

11-24 



FORM 1 



ITEM PARAMETER ESTIMATES 
EIGHT SUBTESTS 



Numbart Subtatt (27 ittmt) 



t . 

E2 

E3 

E4 

E5 

E6 

E7M 

E8 

E9M 

E10M 

Ell 

E12M 

MIO 

M2D 

M3 

IMD 

M5 



Mil 

D3 

D5 

D7 

D9 

DIG 

Oil 

012 



It«in 

E13 

EM 

E15 

EI6 

E17M 

E18 

E19 

E20M 

E21M 

Mf3 

Mt4D 

MIS 

M160 

M18 

MI9 

013 

D15 

D17 

D18 

D19 

D20 

02 1 



SI ops 


1 . • • 


Threshold 






Bit 




0. 538 


0. 068 




934 


0. 253 




106 


0. 047 


0. 333 


0. 054 




104 


o! 1 86 


0 


116 


0 . 036 


0.374 


0.067 


0. 


755 


o! 146 




. 1 29 


0 .02 3 


0.608 


0.096 


0. 


601 


0.112 


0 


' 108 


0 *02 2 


0.402 


0. 060 


-0. 


503 


0. 08 ) 


0 


109 


0 . 032 


0.647 


0. 094 


-0. 


630 


0. 090 


0 


089 


0 . 033 


0.824 


0.071 


0. 


453 


0 . 055 


0 


.099 


0 013 


1 .431 


0. 228 


0. 


561 


o! 1 25 


0 


05 1 


0 0 1 6 


0. 302 


0. 039 


0. 


651 


o! 1 1 5 


0 


125 


0.015 


0.7 55 


o! 057 


0.349 


o! 043 


Q 


070 


0.014 


1 .228 


0. 139 


1.016 


0. 149 


Q 


046 


0.014 


0. 386 


0. 039 




143 


o! 1 20 


Q 


11/! 


0. 02 S 


0.265 


0 ! 046 


4. 


302 


0 763 


Q 


117 


0 . 009 


0.808 


o!o60 


-0. 


091 


0.'033 


0 


091 


0.016 


0. 570 


0 . 060 


-0. 


126 


0. 041 


0 


089 


O.U^"* 


0.834 


0.059 


-0. 


030 


0.033 


0 


087 


0.018 


0.257 


0,044 


0. 


929 


0. 166 


0 


135 


0.020 


0.716 


0.050 


0. 


601 


0.054 


0 


104 


0.014 


0.891 


0.060 


0. 


621 


0.056 


0 


130 


0.013 


0.631 


0.061 


-0. 


934 


0. 100 


0 


102 


0.030 


0.440 


0.049 




686 


0. 195 


0 


104 


0.019 


0.310 


0.043 


-o! 


061 


0.041 


0 


115 


0.029 


0.861 


0.067 


0. 


7 50 


0.078 


0 


079 


0.021 


1.110 


0.056 




737 


0. 115 


0 


042 


0.012 


0.760 


0.053 




762 


0. 139 


0 


074 


0.014 


0.511 


0.066 


-0.' 


039 


0.044 


0 


114 


0.029 


0.6^5 


*0.063 


0. 


505 


0.069 


0 


109 


0.024 



. Al0«br« Subtait (22 ftami) 



Slops 


t . • . 


Thr athoid 


f . • . 


0 


727 


0. 1 14 


0.294 


0.074 


0 


444 


0.075 


0.760 


0. 144 


0 


401 


0.070 


0.442 


0.094 


0 


735 


0.092 


-1.938 


0.255 


c 


526 


0.046 


-1 .022 


0.095 


0 


761 


0. 124 


0.349 


0.082 


0 


649 


0. 100 


0.453 


0.090 


0 


560 


0.083 


2.806 


0.425 


0 


434 


0.054 


1.251 


0. :61 




127 


0.098 


-0.494 


0.066 




276 


0. 104 


-0.066 


0.040 


0 


561 


'0. 147 


3.792 


1.015 




124 


0.089 


-0.069 


0.039 


0 


812 


0.089 


0.213 


0.052 


0 


424 


0.048 


-1 .037 


0. 125 


0 


645 


0.083 


-0.015 


0.048 




566 


0. 1 12 


0.840 


0. 101 




206 


0.059 


1 .805 


0. 121 


0 


669 


0.063 


0.959 


0. 103 


0. 


632 


0.060 


1 .977 


0. 165 


0. 


552 


0.057 


2.306 


0.252 


0. 


719 


0.070 


0.247 


0.054 



Ittm 


Slops 


£22 


0.504 




0.596 


0.445 


E25 


0.570 


E26 


0.713 


E27 


0.445 


E28 


0.433 


E29 


0.509 


E30 


0.464 


M22 


0.601 


M24 


0.416 


M25 


0.572 


M26 


0.483 


M27D 


c-0.459 


M28 


0.616 


M29 


0.370 


M30 


0.404 


022 


0.716 


023 


0.400 


024 


0.524 


025 


0.548 


026 


0.771 


028 


0.681 


029 


0.61 1 


030 


0.642 



At ymptota 

0. 125 
0. 160 
0. 162 
0. 127 
0.130 
0. 116 
0. 123 
0. 142 
0. 171 
0.116 
0.082 
0.093 
0. 104 
0. 120 
0. 135 
0. 151 
0. 102 
0.042 
0. 133 
0. 104 
0. 124 
0. 130 



Caomatry Subtatt (25 itamt) 



0.085 
0.065 
0.06k 
0.094 
0. 112 
0.095 
0.081 
0.092 
0.086 
0.065 
0.073 
0.062 
0.073 
0.056 
0.069 
0.073 
0.063 
0.092 
0.060 
0.071 
0.072 
0. 109 
0.093 
0.073 
0.083 



0.026 
0.024 
0.027 
0.057 
0.025 
0.026 
0.025 
0.003 
0.013 
0.026 
0.C17 
0.009 
0.017 
0.016 
0.030 
0.029 
0.019 
0.013 
0.021 
0.015 
0.016 
0.026 



Thr atho Id 


• 1 . a . 


Atymptota 


1 . a . 


-0.277 


0.070 


0 


137 


0.033 


0.391 


0.055 


0 


128 


0.0i7 


0.313 


0.076 


0 


141 


0.026 


0.700 


0. 129 


0 


122 


0.024 


-0.928 


0. 156 


0 


136 


0.041 


2.409 


0.523 


0 


127 


r 7 


• 1.335 


0.256 


0 


140 


X. 2i 


1 .044 


0. 199 


0 


135 


0.023 


0.936 


0. 183 


0 


148 


0.023 


-0.401 


0.07C 


0 


129 


0.027 


2.121 


0.379 


0 


136 


0.014 


0.052 


0. 131 


0 


132 


0.016 


0. 131 


0.045 


0 


140 


0.023 


2.372 


0.263 


0 


139 


0.010 


-2.17*/ 


0. 198 


0 


137 


0.055 


2.006 


0.405 


0 


178 


0.016 


0.256 


0.056 


0 


146 


0.022 


0.521 


0.066 


0 


125 


0.021 


-1 .546 


0.237 


0 


147 


0.040 


0.057 


0.047 


0 


142 


0.026 


2. 163 


0.294 


0 


096 


0.015 


0. 143 


0.059 


0 


134 


0.025 


0.351 


0.070 


0 


127 


0.023 


1 .290 


0. 166 


0 


123 


0.017 


0.497 


0.063 


0 


131 


0.023 



nt Subtatt (23 itamt) 



Ittm 

E31M 

E32 

E33 

E34M 

E35 

E36 

E37 

E38 

E39 

M32 

M33 

M35 

r '50 

M^ 

M38 

M39 

03! 
032 
033 
034 
035 
038 
039 



Slopa 
0.606 
0.397 
0.360 
0.615 
0.959 
0.436 
0.530 
0.528 
0.369 
0.465 
0.965 
0.376 
0.755 
0.453 
0.415 
0.354 
0.446 
0.525 
0.590 
0.653 
0.763 
0.439 
0.81 1 



« . •. 

0.071 
0.083 
0.075 
0.062 
0. 133 
0.072 
0. 127 
0.099 
0. 120 
0.065 
0. 128 
0.067 
0.073 
0.046 
0.059 
0. 107 
0.066 
0.064 
0.067 
0.071 
0.074 
0.060 
0.097 



Thrathold 


t . a . 


Atymptot a 


t . a . 


0.596 


0.066 


0. 


065 


0.013 


1.073 


0.231 


0. 


141 


0.022 


0.867 


0. 179 


0. 


140 


0.024 


0.719 


0.082 


0. 


126 


0.014 


0.906 


0. 146 


0. 


077 


0.019 


-0.709 


0. 130 


0. 


134 


0.035 


2. 91 


0.729 


0. 


088 


0.013 


0.264 


0.086 


0. 


132 


0.025 


3.517 


1.095 


0. 


153 


0.015 


1 .835 


0.265 


0. 


118 


0.014 


0.030 


0.049 


0 


090 


0.022 


2. 143 


0.383 


0. 


179 


0.015 


-0.274 


0.042 . 


0. 


1 10 


0.020 


0.079 


0.030 


0. 


123 


0.016 


0.892 


0. 134 


0. 


142 


0.019 


4.905 


1.495 


0. 


096 


0.010 


1 .057 


0. 164 


0. 


148 


0.02 1 


1.3ri 


0. 175 


0. 




0.019 


2. 130 


0.253 


0 


In ' 


0.015 


1.469 


0. 174 


0. 


120 


0.017 


1 .283 


0. 140 


0. 


103 


0.016 


1 .003 


0.145 


0. 


135 


0.022 


0.756 


0.107 


0. 


116 


0.021 



ERIC 



III- 1 
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ProbabiHty and $t«t{it<ci Subtait (16 Itaaii) 



E40 

E41 

E42M 

E43 

E44 

E4S 

IMO 

IM1 

IM3 

M44 

M4SD 

D40 

D41 

D42 

D43 



Itaai 

El 

E4 

E7M 

ElOM 

E13 

E16 

E19 

E22 

E2S 

E2a 

E31M 

E34M 

E40 

E43 

MIC 

M4D 

M13 

M16D 

M19 

M22 

M2S 

M28 

M37D 

1140 

IM3 

D7 

D10 

D13 

D19 

D22 

D2S 

028 

031 

034 

D40 

D43 



Itam 

E2 

ES 

E8 

Ell 

E14 

E17M 

E20M 

E23M 

E26 

E29 

E32 

E3S 

E38 

E41 

E44 

M2D 



Mil 

Ml 40 

M26 

M29 

M32 

M3S 

M38 

M41 

M44 

09 

Oil 

017 

020 

023 

026 

029 

032 

035 

038 

041 

044 



Sf opa 
0.412 
0.478 
0.662 
0.525 
0.516 
0.720 
0.426 
0. 742 
0.705 
0.460 
0.653 
0.746 
0.751 
0.502 
0.514 
0.436 



S I op« 
0.488 
0.620 
0.S2S 
0. 755 
0.638 
0.471 
0.585 
0.437 
0.460 
0.5fi7 
0.6$^ 
0.413 
0.621 
0.360 
0.4-2 
0.^70 
0.808 
0.778 
0 869 
0.476 
0.410 
0.566 
0.549 
0.460 
0.431 
0.795 
0.859 
0.623 
0.546 
0.710 
0.938 
0.601 
0.663 
0.467 
0.544 
0.851 
0.390 



t • • 


Th rat ho 1 d 




ynpx Ola 


1 • a • 




0. 109 


2 . 358 


0. 574 


0 • 1 28 


J . Ol 7 




0.087 


-1 . 132 


o! 2 13 


o! 1 35 


0 . 040 




0.073 


0. 734 


0 .C90 


o! 1 22 


0 . 0 M 




D. 109 


-0.019 


0 . 053 


0 . 1 26 


v . uou 




0. 089 


-2 ! 560 


0. 448 


0. 132 


0. 058 




o! 171 


o! 133 


o!o66 


0.' { la 


0.027 




0.090 


3.916 


0.835 


0.085 


O.OlO 




0.089 


-0.965 


0. 120 


0. 124 


0.035 




0.087 


0.667 


0.095 


0. 106 


0.019 




0.069 


1 .698 


0.263 


0. 146 


0.016 




0.067 


0.800 


0.090 


0. 135 


0.014 




0.098 


-1 .C08 


0. 163 


0. 125 


0.045 




0. 152 


-0.000 


0.052 


0. 1 18 


0.027 




0.088 


2.572 


O.X58 


0. 123 


0.014 




0.087 


0.93C 


0. 167 


0. 137 


0.C21 




0. 102 


3. 195 


0.758 


0. 104 


0.01S 





Procadural Sk It I • Subtatt (37 Itami) 



t . a. 

0.068 
0. 110 
0 059 
0.058 
0.09! 
0.071 
0.094 
0.068 
0.076 
'0.096 
0.057 
D.043 
0. 138 
0.095 
0.078 
0.042 
0.062 
0.071 
0.056 
0.053 
0.048 
0.061 
0.060 
0.038 
0.084 
0.080 
C.070 
0.052 
0.067 
0.061 
0.081 
0.055 
0.068 
0.051 
0.052 
0. 127 
O.048 



Thr a tho I d 

-2 . 082 
0.547 
0.583 
0.391 

-0. 115 

-2.925 
0.065 

-0.674 
0.437 
0.566 
0.55^ 
0. 752 
2.223 
2.603 

-0.281 
3.696 
0.059 

-0.437 

-0 . 02 1 

-0.892 

-0.675 
0.672 

-2 .952 
0.026 
3.721 
0.452 
0.743 
1 857 

-0. 129 
2. 188 
0.706 
2. 191 
0.617 
0.980 
1 .649 

-0.902 
1.311 



* . a. 


Af yr.ptota 


t . a. 


0. 297 


0. 105 


0.047 


0.114 


0 


1 10 


0.022 


0.065 


0 


095 


0.014 


0.045 


0 


075 


0.014 


0.054 


0 


093 


0.027 


0.446 


0 


105 


0.055 


0. 053 


0 


096 


0. 026 


0. 116 


0 


107 


0.0:^3 


0.088 


0 


101 


0.024 


0. 113 


0 


097 


C.022 


0.057 


0 


081 


0.013 


0.085 


0 


097 


0.015 


0.507 


0 


072 


0.014 


0.692 


0 


130 


0.016 


0.068 


0 


104 


0.030 


0.580 


0 


091 


O.OlO 


0.033 


0 


116 


0.016 


0.060 


0 


086 


0.02c 


0.032 


0 


074 


0.017 


0. 108 


0 


107 


0.03C 


0.088 


0. 


106 


0.027 


0.085 


0. 


105 


0.017 


0.128 


0. 


10«» 


C.'^53 


0.028 


0 


096 


0 L>9 


0.735 


0. 


083 


0.009 


0.065 


0 


032 


0.017 


0.080 


p 


090 


C.020 


0. 168 


t 


071 


0.016 


0.047 


0 


110 


C.030 


0.205 


0. 


100 


0.014 


0.082 


0. 


095 


0.020 


0.212 


0. 


080 


0.014 


0.079 


0. 


099 


0.023 


0. 117 


0. 


103 


0.0^:2 


0. 1tf6 


0. 


090 


0.017 


0. 147 « 


0. 


094 


0.043 


0. 169 


0. 


1 10 


0.021 



Knowladga of Facts and Conraptf Subtait (19 itanr) 



S t opa 

0.320 
0.357 
1.065 
0.611 
0.394 
0.478 
0.364 
0.476 
0.730 
0.750 
0.510 
0.690 
^0. 754 
0.482 
0.442 



.843 
.264 
.036 
.674 



0. 
0. 
1 . 
0. 
0.990 
0.380 
0.428 
0.539 
0.360 
0.575 
0.529 
0.352 
0.320 
0.519 
0.797 
0.476 
0.563 
0. 719 
0.779 
0.476 
0.724 
0.562 
0.580 
0.403 



I . a. 

0.057 
0.056 
0. 116 
0.088 
0.063 
0.042 
0.066 
0.050 
0.085 
0. 107 
0.072 
0.086 
0. 126 
0.071 
0.086 
0.070 
0.049 
0.078 
0.063 
0.081 
0.052 
0.071 
0.072 
0.067 
0.075 
0.055 
0.066 
0.048 
0.067 
0.056 
0.055 
0.068 
0.073 
0.062 
0.052 
0.059 
0.051 
O.065 
0.070 



Thrctho I d 
-0.623 
-0.240 
0.953 
2.270 
0.5'7 
•-1 . 1 14 
3.201 
0.296 
-1 .001 
0.725 
0. 785 
1 .500 
0.336 
-1 . 108 
-2.820 
-0.091 
1 .074 
0.538 
-0.951 
-0.007 
-0.065 
1 .253 
1 .225 
1 .989 
0.452 
-1 .432 
1 .782 
0.025 
-0.035 
2.285 
2.471 
-0.896 
0.412 
1 .403 
1 .636 
1 .590 
0.921 
0.353 
3.608 



t .a . 
0. 155 
0.061 
0. 130 
0.341 
0. 106 
0. 103 
0.585 
0.045 
0. 132 
0. 123 
0. 124 
0.203 
0.083 
0. 171 
0.553 
0.035 
0.205 
0.058 
0.099 
0.035 
0.039 
0.213 
0. 172 
0.375 
0.074 
0. 155 
0.339 
0.042 
0.046 
0. 179 
0.295 
0. 119 
0.065 
0. 129 
0. 187 
0. 145 
0.096 
0.061 
0.639 



Air«ptota 

0. 145 
0. 132 
0.0S6 
0.089 
0. 129 
0 125 
0. 103 
0 . 1 '< ; 
0. I2t 
0. '17 
0 1-1 
C.I 1C 
0. 125 
0. 131 

0. 134 

0. 122 
0, 157 
0. 142 
0. 117 
0. 100 
0. 118 
0. 141 
0.094 
0. 179 
0. 140 

0. 131 

0. 143 
0. 143 
0. 134 
0.051 
0. 1 13 
0. 127 
0. 1 10 
0. 117 
0. '23 
0. 124 
0. 1 14 

0. 131 

0. 103 



s . a . 

0.035 
0.031 
0.018 
0.014 
0.02s 
0.026 
O.OlO 
0.016 
0.C41 
0.021 
0.023 
0.016 
0.024 
0.039 
0.0S6 
0.018 
0.019 
0.012 
0.031 
0.017 
C.023 
0.017 
0.015 
0.015 
0.019 
0.035 
0.016 
0.029 
0.029 
0.013 
0.016 
0.040 
0.026 
0.01? 
0.018 
0.016 
0.021 
O.C26 
0.015 



ERIC 



T T T-2 



S2 



Hightr Ltv«i Thinking Subt««t (37 U«m«) 



1 t«m 


S 1 op« 




Thrufho 


E3 


0. 396 


0. 083 


1 


134 


E6 


0. 679 


0. 102 


-0 


454 


E9M 


0. 438 


0.050 


0 


787 


El2M 


0.475 


0.049 


-0 


787 


E15 


0.456 


0.085 


0 


230 


Eie 


0/ 567 


0 .' ! ! 0 


0 


356 


E2fM 


0.3 10 


o! 053 


2 


.111 


E24 


0. 333 


o! 067 


0 


490 


E27 


0. 678 


0.114 


1 


.590 


E30 


0. 565 


o! 107 


0 


706 


E33 


0.474 


o!o9o 


0 


760 


E36 


0.629 


0. 095 


-0 


.54 5 


E29 


0. 476 


0. 1 06 


2 


618 


E42M 


0 .' 7 1 1 


0.070 


0 


676 


E45 


0. 7 84 


0. 1 50 


0 


124 


M3 


0. 542 


0. 065 


0 


096 


M6D 


0.817 


0.060 


0 


620 


Ml5 


0.« 15 


o! 1 35 


4 


531 


yiB 


0. 637 


0.08 1 


0 


604 


M24 


0. 384 


0.07 1 


2 


626 




1 .Qj66 


0. 06 1 


1 


575 


1130 


0. 353 


0. 05 1 


0 


319 


M33 


0. 933 


0.112 


0 


009 


II33D 


0. 773 


0.'07 1 


-0 


231 


M39 


0. 384 


0. 1 24 


'* 


776 


iu&o 


0. 558 


0. 045 


0 


910 


D3 


0.697 


o!o59 


1 


355 


D9 


o.8ca 


0.062 


1 


957 


D12 


0.634 


0.068 


0 


412 


D15 


1. 268 


•0.097 


0 


902 


Dia 


0.750 


0.072 


0 


895 


D21 


0.65# 


p. 077 


0 


175 


D24 4» ^ 


0.430 


^ 0.048 


0 


284 


D30 


0.573 


0.063 


0 


646 


D33 


0.648 


0.064 


2 


203 


D39 


0.768 


0.076 


0 


655 


D42 


0.399 


0.061 


3 


286 



• p < .05 

p < .CI 



V 



• . • . 


Afvmptott 


« . • . 


0. 245 


0. 


177 


0.022 


0. 087 


0. 


134 


0.033 


0.096 


0. 


152 


0.0*5 


0. 088 


0. 


1 56 


0.024 


0 . 070 


0. 


164 


0.027 


O.Ofl9 


0. 


14 t 


0.026 


0. 357 


0. 


208 


0.013 


0.112 


0. 


172 


0.027 


0. 280 


0. 


123 


0.017 


0. 147 


0. 


155 


^^.023 


0.155 


0. 


150 


J. 024 


0.099 


0. 


139 


0.035 


0 64 1 


0. 


146 


0.015 


0. 07 8 


0. 


140 


0.014 


0.064 


0. 


133 


0.076 


0. 042 


0. 


136 


0.022 


0.059 


0. 


138 


0.013 


1 .483 


0. 


085 


0.009 


0.090 


0. 


152 


0.018 


0.489 


0. 


172 


0.013 


0.113 


0. 


170 


0.009 


0.060 


0. 


163 


0.022 


0. 047 


0. 


108 


0.022 


0.039 


0. 


139 


0.020 


1 . 551 


0. 


107 


0.010 


0.082 


0. 


139 


0.014 


0 131 


0. 


140 


0.017 


0.' 161 


0. 


072 


0.012 


0.066 


0. 


143 


0.024 


0. 105 


0. 


135 


0.018 


0. 104 


0. 


155 


0.020 


0.053 


0. 


148 


0.026 


0.055 


0. 


148 


0.026 


0. 107 


0. 


157 


0.022 


0.232 


0. 


130 


0.014 


0. 103 


0. 


134 


0.020 


0.514 


0. 


128 


0.014 



t 



III-3 



FORM 2 

ITEM PARAMETER ESTIMATES 
EIGHT SUBTESTS 



Nu«b«rf Subtvft (27 U«»t) 





Slop* 


t 


El 


0.3S6 


0.071 


E2 


0.461 


0.067 


E3M 


0.733 


0.054 


E4 


0.444 


0.093 


E5 


0.602 


0.068 


E6 


0 529 


0.074 


E7M 


W.755 


0.06: 


E6 


0.868 


0.085 


E9M 


0.541 


0.054 


ElO 


0.648 


0.0S2 


E11M 


0.468 


0.044 


E'2M 


0.488 


0.O47 


MID 


0.487 


0.O44 


M2D 


0.349 


0.038 


M4 

MS 


0.730 


0.083 


0.789 


0.082 


M60 


0.725 


0.047 


M8 


0.425 


0.056 


MlOO 


0.461 


0.040 


D3 


0.659 


0.087 


D4 


0.68>« 


0.094 


OS 


0.471 


0.051 


D7 


0.668 


0.056 


D8 

D9 


1 .135 


0.069 


1 .038 


0.083 


D11 
D12 


0.637 
0,439 


•0.075 
0.066 



It«lll 

E13 
E14 
E15 
E16 
E17 
E1S 
E19M 

e;o 

E21 

MOD 

M14D 

MIS 

M16 

M17 

M18D 

M20D 

M21D 

D15 

D16 

D17 

D19 



Yhr«tho I d 
1.059 
-0.470 
-0.832 
1.690 
-1.092 
-0.235 
0.999 
-0.738 
0.854 
-1.917 
-0.950 
-0.000 
0.646 
0.088 
0.289 
-0.722 
0.927 
0.906 
-0.856 
-O.303 
-0.587 



.323 
.342 
.267 
.722 
.499 
.259 



t .*. 
0.218 
0.084 
0.070 
0.360 
0.135 
0,060 
0.091 
0.094 
0.092 
0.195 
0.094 
0.030 
0.066 
0.029 
0.053 
0.087 
0.069 
0. 126 
0.080 
0.063 
0.095 
0. 153 
0. 127 
0. 104 
0.083 
0.076 
0.056 



Atymptot • 
0.137 
0. 125 
0.116 
•>. 131 
C. 121 
C. 117 
0 074 
0. 130 
0. 109 
0. .21 
0. 1 18 
0. 1 '7 
0. 144 
0. 136 
0.093 
0. 114 
0.07S 
0. 126 
O. 113 
0. 126 
0. 120 
0.118 
0. 100 
0.066 
0.091 
0. 1 15 
0. 129 



Algabr* SubtVft (21 ftvmt) 



s . • . 

0.022 
0.030 
0.024 
0.018 
0.037 
0.028 
0.01 1 
0.032 
0.013 
0.048 
0.024 
0.018 
0.015 
0.018 
0.020 
0.030 
0.012 
0.018 
0.024 
0.031 
0.035 
0.019 
0.018 
0.015 
0.020 
0.034 
0.030 



Slop* 


1 . • . 


Thr*gho 1 d 


f . •. 


Asymptot* 


t .* . 


0.38O 


0.070 


-0.044 


0.054 


0.217 


0.031 


0.651 


0. 1 13 


1 .329 


0.246 


0.230 


0.019 


0.900 


0. 131 


-0.723 


0.125 


0. 179 


0.039 


0.693 


0. 105 


-0.776 


0. 132 


0. 190 


0.039 


0.571 


0.081 


-1.118 


0. 170 


0. 197 


0.042 


0.601 


0. 103 


-0.234 


0.069 


0.201 


0.032 


0.717 


0.095 


0.549 


0.083 


0. 135 


0.015 


0.626 


0.098 


0.799 


0. 140 


0. 164 


0.024 


0.530 


0.095 


0.462 


0. 103 


0.232 


0.025 


0.574 


0.062 


0.821 


0.098 


0.230 


0.014 


0.999 


0 061 


1 635 


0.121 


0. 147 


0.009 


0.527 


0.030 


-0.345 


0.073 


0.206 


0.026 


0.490 


0. 159 


3.727 


1 .223 


0. 144 


0.010 


0.616 


0. 1 1 J 


0.003 


0.044 


0.202 


0.022 


0.733 


0.065 


0.891 


0.090 


0. 194 


0.013 


0.719 


0.058 


1.172 


0.106 


0. 170 


0.012 


0.711 


0.059 


2,214 


0. 197 


0. 181 


0.009 


0.798 


0.099 


0.256 


0.066 


0. 199 


0.0^6 


0.85O 


0.081 


0.691 


0.089 


0. 158 


0.022 


0.551 


0.065 


2.455 


0.302 * 


0.201 


0.015 


0.890 


0. 120 


0.350 


0.080 


0. 192 


0.027 



G*oai*try Subt*ct (26 U«Mt) 



It*i«i 

E22 

E23 

£24 

E25 

E26 

E27 

E28 

E29M 

E30 

M22 

M23 

M24 

M25 

M26 

M27 

M28 

M30 

D22 

D23 

D24 

D25 

D26 

D27 

028 

D29 

D30 



S 1 op* 


f . * . 


Thr*sho1 d 


1 • • • 


Af yaiptot* 


• .* . 


0.582 


0.084 


1 .284 


0.048 


6. 101 


0.024 


0.342 


0.060 


-0.045 


0.218 


0. 134 


0.035 


0.671 


0.091 


1 .705 


0.087 


0.086 


0.021 


0.47C 


0.057 


-0.526 


0.213 


0.097 


0.039 


0.475 


0.071 


- 1.789 


0. 104 


0. 1 19 


0.022 


0.386 


0.063 


0.927 


0.057 


0. 120 


0.028 


0.620 


0.086 


1.713 


0.090 


0.112 


0.021 


0.412 


0.041 


0.913 


0.058 


0. 115 


0.014 


0.590 


0.08f 


0.984 


0.053 


0.111 


0.027 


0.396 


0.049 


0.683 


0.137 


0. 122 


0.015 


0.531 


0.055 


0.149 


0.064 


0. IOC 


0.017 


.0.801 


0.081 


0.089 


0.065 


0.093 


0.016 


0.327 


0.0*9 


2. 144 


0.386 


0. 104 


0.012 


0.395 


0.049 


1 .390 


0.222 


0. 109 


0.013 


0.395 


0.051 


-0.992 


0.085 


0. 119 


0.024 


0.643 


0.053 


1 .276 


0. 144 


0.081 


0.01 1 


0.485 


^ 0.061 


3.451 • 


0.489 


0.062 


0.007 


0.595 


0.04& 


-1.391 


0. 101 


0. 177 


0.024 


0.697 


0.O47 


1 .282 


0. 103 


0.131 


0.009 


0.842 


0.042 


1 .588 


0.098 


0. 135 


0.007 


0.795 


0,063 


-0.314 


0.033 


0. 149 


0.016 


0.992 


0.054 


1 .597 


0. 113 


0 135 


0.C07 


0.827 


0.C58 


0.937 


0.085 


0. 170 


0.010 


0.888 


0.058 


1 .476 


0. 121 


0.211 


0.008 


1 .405 


0. 156 


-0.009 


0.042 


0. 128 


O.OM 


0.838 


0.054 


1 . 167 


0.095 


0. 131 


0.010 



M**tur*M*At Subt*ft (22 it*iiit> 



U*M 

E31M 

E32M 

133 

E34M 

E35 

E36 

E37 

E38 

E39 

M33 

M36D 

M36D 

M37 

M38 

M39 

D31 

032 

D33 

D34 

D37 

D38 

039 



Slop* 


t . * . 


Thr*tho f d 


• . * . 




plot* 


• .* . 


0.837 


0.065 


0.887 


0.081 




110 


0.012 


0.445 


0.050 


0.649 


0.081 


0. 


169 


0.016 


0.488 


0. 122 


3.268 


0.831 


0. 


124 


0.014 


0.399 


0.049 


0.815 


0. 106 


0. 


169 


0.01S 


0.616 


0. 117 


1 .442 


0.285 


0. 


163 


0.0'ft 


0.571 


0.094 


0.604 


0. 116 


0. 


149 


0.023 


0.527 


0. 108 


2.290 


0.480 


0. 


169 


0.016 


0.638 


0. 126 


0.406 


0. 100 


0. 


148 


0.026 


0.800 


0. 116 


1 .922 


0.304 


0. 


100 


0.015 


0.378 


O.OPO 


1 .877 


0.306 ' 


0. 


198 


0.016 


0.437 


0.062 


2.215 


0.270 


0. 


198 


0.01 1 


0.472 


0.046 


0.369 


0.047 


0. 


♦57 


0.017 


1 .244 


0.212 


-0.243 


0.072 


0. 


138 


0.027 


0.931 


0.080 


0.885 


0.093 


0. 


115 ^ 


0.016 


0.551 


0.067 


2.051 


0.259 


0. 


137 ' 


0.014 


0.870 


0.092 


0.750 


0. 100 


0. 


130 


0.020 


0.540 


0.076 


-0. 19:; 


0.054 


0. 


155 


0.029 


0.704 


0.087 


0.430 


0.075 


0. 


140 


0.023 


0.840 


0.086 


0.909 


0. 113 


0. 


118 


0.020 


0.605 


0.069 


1 .638 


0. 197 


0. 


119 


0.017 


0.428 


0.071 


-0. 185 


0.055 


0. 


170 


0.029 


0.51 1 


0.068 


1 .491 


0.209 


0. 


155 


0.019 



ERIC 



II 1-4 



Probability end Stctittict Subtctt 



<17 U«mt) 



Item 

E40 

E41 

E42M 

E43 

E44 

E45 
M40 
M41 

lUJ 

mit 
D40 

D41 
D42 
D43 
D44 
D45 



El 

E4 

E7M 

E10 

E13 

E16 

E19M 

E22 

E25 

E28 « 

E31M 

E34M 

E37 

E40 

E43 

MID 

M4 

M100 

M13D 

M16 

1122 

M26 

M28 

M37 

M40 

M43 

D4 

D7 

D16 

D19 

D22 

D25 

D28 

D31 

D34 

D37 

D40 

D43 



s i op* 

0.591 
0.481 
0.797 
0.559 
0.753 
0.897 
0.399 
0.948 
0.606 
0.865 
0.905 
0.807 
0.482 
0.520 
0.904 
0.651 
0.570 



Slop* 

0.380 
0.459 
0.928 
0.837 
0.298 
0.405 
0.502 
0.6^ 
0.385 
0.590 
0.911 
0.38' 
0. 530 
0.630 
0.560 
0.497 
0.737 
0.503 
0.420 
0.324 
0.485 
0.331 
0.618 
0.580 
0.633 
0.599 
0.645 
0.643 
0.691 
0.699 
0.724 
0.535 
0.516 
0.646 
0.879 
0.536 
0.427 
0.534 



t . • • 


Thr • ff ho i d 


1 




0.083 


1 . 242 


0 


213 


0.076 


-0.065 


0. 


051 


0.052 


0. 900 


0. 


072 


0.077 


-0.47 5 


o'. 


061 


0 1 13 


"0. 222 


0. 


05 1 


0!l44 


o! 138 


o! 


079 


0.049 


1 .344 


0. 


16b 


0. 101 


-0.526 


0. 


077 


0.069 


3. 106 


0. 


363 


0.080 


0.627 


0. 


068 


0.096 


'0.265 


0. 


054 


0.060 


-1 .004 


0. 


058 


0.076 


3.753 


0. 


658 


0.045 


1 .099 


0. 


128 


0.075 


-0.072 


0. 


038 


0.045 


-1 .826 


0. 


108 


0.046 


0.495 


0. 


074 



Asymptote 

0. 171 
0. 189 
0. 147 
0. 176 
0. 156 
0. 161 
0.207 
0. 168 
0. 112 
0. 192 
0. 160 
0. 109 
0.069 
0. 1 10 
0.087 
0. 103 
0. 116 



Procedural Skills Subtest (38 items) 



s . e . 

0.076 
0.096 
0.066 
0.080 
0.057 
0.068 
'0.053 
0.095 
0.066 
0.098 
0.071 
0.046 
0. 109 
0. 107 
O.086 
0.048 
0.084 
0.044 
0.040 
0.085 
0.063 
0.065 
0.065 
0.072 
0.071 
0.074 
0.079 
0.065 
0.070 
0.078 
0.084 
0.072 
0.063 
0.064 
0.082 
0.058 
0.057 
0.066 



Thr et ho i d 

!.270 
1 .954 
1 .259 

-1.511 

-0.430 

-1 .3"4 
0.6osl 
0.095 

-1 .910 
0. 582 
0.827 
0.744 
2.043 
0.997 

-0.424 
0.785 
0. 377 

-0.765 
0.656 
4.482 
1 .067 
3.075 
1 .963 

-0.409 
0.556 
2.789 

-O. 710 
1 .386 
0. 544 
0.080 

-1 .027 

-O. 185 
1 .916 
1 .004 
0.876 
1 .827 

-0. 760 
0.689 



0.262 
0.417 
0. 105 
0. 162 
0.096 
0.228 
0.076 
0.056 
0.334 
0. 112 
0.078 
0.096 
0.426 
0. 181 
0.084 
0.083 
0.063 
0.074 
0.070 
1 . 184 
0. 145 
0.610 
0.218 
0.066 
0.077 
0.358 
0. 101 
0. 152 
0.075 
0.053 
0. 131 
0.053 
0.24(> 
0. 114 
0. 101 
0.207 
0.111 
0.099 



Asymptote 

0. 156 
0. 145 
0. 142 
0. 136 
0. 162 
0. 149 
0. 160 
0. 129 
0.151 
0. 123 
0. 1 16 
. 157 
. 144 
. 112 
. 142 
. 188 
. 127 
. 147 
. 150 
. 1 10 
. 150 
_ . 161 
0. 100 
0. 149 
0. 131 
0.095 
0. 135 
0. 121 
0. 125 
0. 126 
0. 135 
0. 152 
0. 163 
0. 140 
0.096 
0. 1 i6 
0. 145 
0. 151 



s . • . 

0.018 
0.026 
0.011 
0.029 
0.027 
0.023 
0.014 
0.026 
0.009 
0.015 
0.023 
0.021 
0.006 
0.010 
0.013 
0.029 
0.011 



s . e. 

0.021 
0.017 
0.010 
0.049 
0.032 
0.040 
0.015 
0.027 
0.046 
0.023 
0.012 
0.016 
0.017 
0.022 
0.032 
0.014 
0.019 
0.023 
0.016 
0.01 1 
0.017 
0.014 
0.013 
0.027 
0.019 
0.01 1 
0.035 
0.018 
0.022 
0.029 
0.040 
0.029 
0.016 
''19 
, . 20 
O.016 
0.034 
0.02? 



KnowledQe of Fects end Concepts Subtest (38 items) 



E2 
E5 
E8 

El 1M 

<J14 

b17 

E20 

E23 

E26 

E29M 

E32M 

E35 

E38 

E41 

E44 

M2D 

M5 

M8 

MUD 

M17 

M200 

M23 

M26 

M35D 

M38 

U4i 

D5 

08 

Oil 

017 

023 

026 

029 

032 

038 

041 

044 



Slope 

0.435 
0.430 
0.558 
0.537 
0.419 
0.704 
0.596 
,^0.512 
0.522 
0.553 
0.499 
0. 538 
0.775 
0.510 
0.464 
0.544 
0.688 
0.445 
0.851 
0.430 
0.502 
0.*>iS 
0.565 
0.439 
0.822 
0.450 
0.491 
0.553 
0.903 
0.960 
0.507 
0.659 
0.783 
0.806 
0.506 
0.684 
0.493 
0.353 



s .e • 

0.073 
0.064 
0.080 
0.053 
0.088 
0.076 
0. 1 1 1 
0.074 
0. 103 
0.056 
0.055 
0. 110 
0. 149 
0.089 
0.077 
0.055 
0.085 
0.067 
0.053 
0.062 
0.046 
0.082 
0.073 
0.047 
0.090 
0.065 
0.06F 
0.057 
C.066 

0. 151 

0.055 
0.058 
0.064 
0.084 
0.057 
0.089 
0.074 
0.063 



Thr esho I d 
*-0. 174 
-1 .083 
-0.689 
-0.733 
1 .347 
-1.254 
0.677 
-0.892 
0.805 
0.430 
0.468 
1 .602 
0.403 
-O.O84 
-0. 146 
0.311 
-0.702 
1.217 
1 .831 
0.079 
1 .480 
0. 754 
1.515 
2. 181 
1 .073 
-0.848 

0. 753 
1 .426 

1 . 677 
-0. 323 

2. 252 
1 .639 
2. 104 
0.370 

-0.004 
-0.000 
3.940 
-1 .936 



s. « . 

0.059 

0. 169 

0. 113 

0.079 

0.293 

0. 149 

0. 142 

0. 139 

0. 172 

0.055 

0.061 

0.339 

0. 104 

0.057 

0.058 

0.046 

0.098 

0. 192 

0. 130 

0.041 

0. 142 

0. 1 12 

0.205 

0.240 

0. 132 

C. 130 

0.111 

0. 158 

0. 138 

0.078 

0.256 

0. 1E3 

0. 195 

0.067 

0.047 

0.052 

U.bL 

0.351 



As ympt nt I 
0. 189 
0. 175 
0. 176 
0. 171 
0.201 
0. 167 
0. 174 
0. 176 
0. 183 
0. 146 
0. 164 
0. 178 
0. 190 
0. 185 
0. 181 
0.209 
. 171 
. 193 
. 143 
. 176 
. 155 
. 188 
. 156 
. 195 
. 166 
. 179 
. 165 
. 166 
.111 
. 155 
. 173 
. 133 
. 115 
. 137 
. 175 
^. 165 
0.082 
0. 188 



s . e . 

0.029 
0.037 
0.034 
0.023 
0.021 
0.042 
0.022 
0.036 
0.022 
0.016 
0.016 
0.018 
0.022 
0.028 
0.029 
0.016 
0.030 
0.017 
0.009 
0.072 
0.013 
0.018 
0.015 
0.01 1 
0.015 
0.030 

0 019 

0.018 
0.015 
0.033 
0.016 
0.017 
0.015 
0.026 
0.028 
0.029 
0.01 1 
0.045 



ERLC 



111-5 



fi5 



Hightr L,v»! ThtnkInQ Subttit (37 U«mt> 



It*"* Slop* «.«. 

E3M 0.749 0.058 

IS 0.402 0.071 

0.502 0.054 

E'2M 0.609 0.060 

0.948 0.096 

1^8 0.366 0.062 

IJl 0.484 0.078 

|2f 0 761 0. 130 

§2/ 0.323 0.G8J 

E30 0.430 0.076 

E33 0.528 0. 149 

E36 0.515 C.035 

|39 0.473 0.152 

E42M 0.4;6 0.053 

645 0.667 0.099 

M60 0.771 0.049 

M«5 0.693 0.087 

M580 0.871 0.062 

M210 0.402 0.043 

M24 0.557 0.072 

M27 0.477 0.062 

M30 0.604 0. 115 

M33 0.427 0.068 

M360 0.644 0.054 

M39 0.498 0.080 

M45 0.801 0.094 

03 1 102 0.163 

0.851 0.064 

012 0.6''-> .0.083 

015 0.5^2 0.068 

0.(>46 0.062 

2?Z* * 0-«75 '0-072 

030^ 0.945 0.076 

033 0.805 0.082 

039 0.493 0.056 

042 0.796 0.067 

045 0.540 0.058 



♦ p < .05 
p < .01 



T 0 9 ho ^ d 








mptot* 


t 


• 0. 756 


0.068 


u 


. 147 


0 .024 


o! l64 


0.059 


0 


.177 


0.027 


1 . 097 


0. 124 


0 


. 144 


0.013 


0 . 100 


0.034 


0 


• 1 54 


0.017 




0 


.116 


0 


. 151 


0.039 


"0 . 547 


0 


. 105 


0 


. 183 


0.033 


0 . 0C3 


0 


.054 


0 


. 1 79 


0 .027 


0.514 


0 


. 109 


0 


149 


0.022 


o! 036 


0 


.055 


0 


1 97 


0.029 


0 . 068 


0 


.055 


0 


195 


0.028 


3 ! 1 2 1 


0 


.898 


0 


132 


0.014 


0 782 


0 


. 156 


0 


181 


0.022 


3 . 455 


1 


. 125 


0 


135 


0.014 


J _ g25 


0 


213 


0 


167 


0.013 


0 ! 2 l6 


0 


067 


0 


137 


0.026 




0 


084 


0 


147 


0.011 


"0 . 299 


0 


058 


0 


163 


0.026 


0 . 902 


0 


078 


0 


198 


0.012 


2 ! 30 1 


0 


21 1 


0 


124 


O.OlO 


0 . 874 


0 


123 


0 


176 


0.017 


"0 . 388 


0 


064 


0 


173 


0. 026 


3 ' 746 


0 


737 


0 


082 


0.009 


1 718 


0 


282 


0. 


213 


0.015 


0 344 


0 


044 


0. 


165 


0.0<6 


2 . 439 


0 


400 


0 . 


168 


^.Ol3 


-o! 370 


c 


063 


0 . 


1 55 


0 . 026 


-0. 182 


0. 


067 


0.' 


149 


0.030 


0.891 


0 


090 


0. 


137 


0.019 


-0. 112 


0. 


052 


0. 


165 


0.029 


0.234 


0. 


057 


0. 


179 


0.026 


2.307 


0. 


2 38 


0. 


137 


0.014 


1 .210 


0 


121 


0. 


1£9 


0.017 


1 .502 


0. 


149 


0. 


167 


0.016 


0.601 


0. 


083 


0. 


155 


0.022 


1 .798 


0. 


214 


0. 


170 


0.018 


1 .878 


0. 


182 


0. 


182 


0.015 


1.317 


0. 


153 


0. 


164 


0.019 



III-6 



f>6 



ITEM PARAMETER ESTIMATES 
EIGHT SUBTESTS 



Numbart Subtatt (29 Uamt) 



I tan 

El 

E2 

E3M 

E4 

E5 

E6 

E7 

E6 

E9 

E10 

El 1M 

E12M 

Ml 

M2D 

M4D 

M5D 

M6 

M7 

M8 

MS 

M100 

Dl 

D3 

D6 

D7 

D8 

D9 

D11 

D12 



Itani 

£36 

E39 

E40 

E41 

E42 

E43M 

E44 

E45 

M37 

M38 

M39 

M40 

M41 

M42D 

M44 

M45 

D37 

D38 

D39 

D40 

D41 

D43 

D44 

D45 



It am 

E13M 

E14 

E15M 

E16 

EI7 

E18M 

E19 

E20M 

E21 

M14 

M16 

M17D 

M19 

M21 

D13 

D14 

D16 

D18 

D19 

D20 

D21 



I tan 

F22 

E23 

ES4 

E25M 

E26M 

E27 

E28 

E79M 

E30 

M22 

M23 

M24D 

M27 

M28D 

M300 

D22 

D23 

D25 

D26 

D27 

D29 



S I opa 

0.725 
0.440 
0.554 
0.655 
0.903 
0.947 
1 .263 
0.549 
0.526 
1 .031 
0.647 
0.662 
0.624 
0.665 
1 .464 
1 .297 
0.974 
1 .367 
0.344 
1 .036 
0.607 
1 .326 
0.667 
0.571 
1.501 
989 
927 



0.927 
0.6>7 
0.663 



S I opa 
0.465 
0.472 
0.550 
0.624 
0.499 
0.561 
0.333 
0.531 
0.469 
0.392 
0.362 
0.463 
0.433 
0.474 
0.263 
0.374 
0.495 
0.462 
0.547 
0.628 
0.4d7 
0.324 
0.446 
0.774 



S I opa 
0.889 
0.643 
0.526 
0.267 
0.274 
0.459 
.396 
.457 
.416 
.665 
.531 
.262 
0.606 
0. 591 
0.569 
0.402 
0.533 
0. 580 
0.457 
0.457 
0.501 



SI opa 
0.552 
0.731 
0. 534 
0.524 
0.660 
0.534 
0.649 
0.563 
0. 5F8 
0.396 
0.336 
0.556 
0.416 
0.546 
0.490 
0.483 
0.349 
0.522 
0.564 
0.926 
0.466 



• . a . 

0.076 
0.061 
D.045 
0. 105 
0.077 
0. 144 
0. 136 
0.075 
0.060 
0. 106 
0.044 
0.053 
0.074 
0.046 
0.094 
0.078 
0. 1 1 1 
0. 139 
0.052 
0.090 
0.044 
0.076 
0.092 
0.055 
0. 102 
0.080 
•0.067 
0.066 
p. 1 15 



Thr atho Id 
-0.361 
-0.456 
-0.660 
0.267 
-0.699 

0. 367 

1 . 134 
-0.020 
-1 .r»54 
-0.637 
-1 . 171 
-0.362 
-0.566 

0.266 

0. 155 

0.401 

0.276 

0.441 
-2.357 

0.611 
-0.305 

0.640 
-0.247 

0.746 

0.632 

0.453 

0.67-' 
-0.513 
-0.870 



0.066 
0.081 
0.064 
0.070 
0.099 
0.092 
0. 164 
0.054 
0.132 
0.0S4 
0.067 
0.044 
0.066 
0.P3 • 
C.C»45 
0.04^ 
O.OoS 
0.076 
0.364 
0.091 
0.038 
0.062 
0.060 
0.066 
0.079 
0.066 
0.087 
0.074 
0. 131 



Atymptotl 
0. 133 
0. 17- 
0.16r 
0. 122 
0. 144 
0. 1?0 
0.090 
0. 161 
0. 167 
0. 15S 
0. 1' . 
0. . a 
0. 144 
0. 169 
0. 123 
0. 122 
J. 221 
O. 128 
C. 175 
0.097 
0. 140 
0. 122 
9. 154 
C 164 
C. 100 
0. 166 
0. 172 
0. 156 
0. 154 



AlQabra Subtatt (24 Uamt) 



0.090 
0.066 
0. 1O0 
0. 1 14 
0.090 
0.067 
0.072 
0.097 
0.076 
0.072 
0. 100 
0.077 
0.072 
0.055 
0.097 
0.065 
0.072 
0.076 
0.096 
0.076 
0.075 
0.076 
0.070 
0. 104 



Thr a tho 1 1* 
1 .297 
-0.692 
-0,515 
-0.311 

1 . t36 
0.617 
1 .346 
0.091 
0.430 
0.586 
4.420 
0.935 
1 .314 
0.707 
5.256 
0.690 
1 .963 
0. 168 

-0.612 
1.373 

-0.233 
3.743 

2. w66 
0.672 



t . a . 

0.259 

0. 139 

0. 106 

0.079 

0.267 

0.079 

0.297 

0.056 

0.082 

0. 1 16 

1 .231 

0. 162 

0.223 

0.069 

1 .317 

0. 127 

0.293 

0.053 

0.151 

0.163 - 

0.058 

0.770 

0.377 

0. 107 



At vmpt ot I 
0. 104 
0. 112 
0. 109 
0. 106 
0.095 
0.C36 
0.125 
0. 109 
0. 1 10 
0. 119 
0.073 
0. 113 
0. 106 
0,1 17 
0.062 
0. 1 15 
0. 101 
0. 1 10 
0. 113 
0. 1 10 
0. 112 
0. 109 
0.091 
0.091 



Caomatry Subtatt (21 ftamt) 



.076 
.126 
.056 
.060 
.063 
_.047 
0. 133 
0.050 
0.067 
0.066 
0.057 
0.036 
0.062 
0.061 
0. 107 
0.076 
0.061 
0.061 
0.076 
0.066 
0.089 



Thr a tho t d 
0.647 
0.622 

'-0. 131 
0.276 
0.065 
0.397 
3.436 
0.649 

0. 719 
1 .049 
1 .344 

-1 .074 
1 .391 

1 . 123 
-0.347 

2.567 
-1 .665 

1 . 595 

2. 143 
-0. 126 

0. 130 



t . a . 

0.067 
0. 172 
0.033 
0.078 
0.051 
0.051 
1 .155 
0.096 
0. 159 
0.111 
0. 152 
0. 149 
0. 150 
0. 125 
0.079 
0.497 
0.263 
0.231 
0.363 
0.052 
0.050 



Atymptot 4 
6.070 
0,076 
Q.069 
0. 107 
0. 107 
0.086 
0.063 
0.09E 
0.093 
0.073 
0.074 
0. 103 
0.076 
0.075 
0.066 
0.093 
0.091 
0.069 
0.066 
0.096 
0.091 



Maaturamant Subtatt (21 Uamt) 



0.092 
0. 133 
0.062 
0.061 
0.076 
0.094 
0. 1 14 
0.068 
0.111 
0.C62 
0.067 
0.053 
0.072 
0.052 
0.060 
0.064 
0.059 
0.070 
0.061 
0.086 
O.O06 



Thr a tho I d 
0. 241 
0.333 
-0.432 
0.051 
0.635 
0.523 
0. 162 
0.214 
.636 
.532 
.226 
.971 
.600 
.793 
-.559 
1.612 
.125 
^.623 
0.920 
1 .086 
1 .665 



2.! 

1 .: 



1 . 



-0. 



t . a . 

0.070 
0.089 
0.066 
0.033 
0.061 
0. 1 10 
0.069 
0.043 
0. 160 
0.S28 
0.249 
0. 195 
0. 145 
0. 176 
O.Z27 
0.^46 
0.J50 
0. 123 
0. 140 
O. 124 
0.265 



Atymptot I 
6. 145 

0. 134 

0. 160 
0. 152 
0. 131 
0. 144 
0. 159 

0. 154 

0. 159 
0. 158 
0. 166 
0. 143 
0. 166 
0. 141 
0. 175 
0. 141 
0. 172 
0.155 ^ 
0. 164 
O. 105 
0. 149 



t . • . 

0.U30 
0.031 
0.022 
0.022 
O.CJS 
0 021 
0.014 
0.027 
0.037 
0.D32 
0.027 
0.019 
0.027 
0.016 
0.014 
0.013 
0.017 
0.014 
0.039 
0.013 
0.020 
0.016 
0.034 
0.0?4 
0.021 
0.023 
0.C20 
0.037 
0.046 



% .9. 

0.022 
0.0 J7 
0.035 
0.032 
0.020 
O.OIP 
0.024 
0.029 
0.022 
0.021 
0.01 1 
0.019 
0.017 
0.015 
0.01 1 
0 I 21 
0.017 
0.026 
0.036 
0.016 
0.030 
0.016 
0.017 
0.022 



t . a . 

0.013 
0.020 
0.020 
0.028 
0.029 
0.016 
0.016 
0.014 
0.024 
0.015 
0.016 
0.073 
0.015 
0.016 
0.030 
0.015 
0.044 
0.017 
0.016 
0.029 
0.026 



t . a . 

0.026 
0.024 
0.031 
0.018 
0.014 
0.024 
0.026 
0.016 
O.C 2 
0.015 
0.019 
0.01 1 
0.020 
0.01 1 
O.OlO 
0.016 
0.029 
0.022 
0.C21 
0.019 
0 019 



ERIC 



1 1 1 - 7 87 



Probabnity and Statistics Subtest (l5 1t«ms> 



Itam 

E31 

E32 

E33 

E34 

E35 

E36 

M31 

M32 

M33 

M340 

M350 

M360 

031 

032 

033 



Itam 

Et 

E4 

E7 

ElO 

E13M 

E16 

E 9 

E22 

E25M 

E28 

E31 

E34 

E40 

E43M* 

Ml 

M40 

M7 

MlOO 
MI6 
M19 
M22 
M260 
M31 



M37 
M40 

01 

07 

013 

016 

019 

022 

025 

031 

037 

040 

043 



Itam 

E2 
E5 
E6 

E11M 

E14 

E17 

E20M 

E23 

E26M 

E29M 

E32 

E35 

E38 

E41 

E44 

M20 

M50 

MS 

M14 

Ml 70 

M23 

M32 

M350 

M38 



08 

Oil 
014 
020 
023 
026 
026 
032 
038 
041 
044 



S 1 opa 


t . a . 


Thr asho 1 d 




1 ^ 


0.927 


0.061 


1 . 848 


0 


. 182 


0.662 


0.059 


-0. 5l 5 


0 


. 030 


0.671 


0.043 


-0.06 


0 


!044 


1 .369 


0.056 


0. 708 


0 


.07 5 


0.893 


0. 101 


-0. 598 


0 


!032 


0.718 


0.069 


*G.639 


0 


.029 


0.451 


0.096 


3.416 


0 


757 


0.428 


0.057 


-1 . 1 72 


0 


145 


0.436 


0.073 


0.327 


0 


082 


0.367 


0.047 


1 .035 


0 


1 14 


0.530 


O.Obd 


-0.321 


0 


057 


0.455 


0.052 


0.451 


0 


044 


0.516 


0.070 


0.936 


0 


066 


0.576 


0.089 


-0.250 


0 


109 


0.742 


0. 107 


0.538 


0 


052 



Asymptota 

0. 155 
0. 176 
0. 135 
0.074 
0. 150 
0. 152 
O.06O 
0. MO 
0. 114 
0. 116 
0.116 
0.111 
0. 109 
0.117 
0.097 



Procadural Sk M I s Subtast (37 itams) 



S I opa 

0.870 
0.568 
0.999 
0.641 
0.690 
0.387 
0.544 
0.598 
0.43-5 
0.>^8 
0.532 
0.838 
0.516 
0.600 
0.994 
0.912 
0.97S 
0.626 
0.535 
0.852 
0.525 
0.931 
0.949 
0.518 
0.522 
0. 747 
1 .479 
1 .247 
0.724 
0.51 1 
0.639 
0.478 
0.491 
0.419 
0.553 
0.713 
0.371 



s . a . 

0. 1 12 
0.091 
0. 131 
0.062 
0.059 
0.062 
0. 156 
0.091 
0.040 
0.082 
•0. 121 
0. 126 
0.067 
0.055 
0.097 
0.058 
0.093 
0.047 
0.064 
0.066 
0.086 
0.046 
0.083 
0.042 
0.059 
0.079 
0.069 
0.087 
0.074 
0.062 
0.056 
0.050 
0.048 
0.045 
0.054 
0.049 
0.071 



Thr asho Id 

-0.375 
0. 501 
1 . 27 1 

-0. 765 
0.711 
0. 155 
3.072 
0.205 

-0. 162 

0. 260 
2.642 

1 . 576 
-0. 700 

0.496 
-0. 535 
0. 166 
0.605 
-0.329 
1 .380 
1 . 102 
2.247 
1 .016 
1 .980 
0.950 
0.293 
0. 536 
0. 753 
0.605 
0. 177 
-1,318 
2.338 
2.000 
1 .033 
0.864 
2.316 
1 .535 
3.719 



• . a. 

0.076 
0.096 
0. 193 
0. 112 
0.071 
0.055 
0.699 
0.063 
0.033 
0.072 
0.615 
0.259 
0. 104 
0.057 
0.066 
0.036 
0.077 
0.039 
0. 173 
0. 127 
0.367 
0.063 
0. 197 
0.085 
0.052 
0.074 
0.064 
0.075 
0.054 
0. 170 
0.221 
0.216 
0. 1 13 
0. 104 
0.236 
0. 122 
0.722 



As yiflpt ot a 
0. 105 
0. 121 
0.081 
0. 120 
0. 106 
0. 133 
0.069 
0. 121 
0.119 
0. 139 
0. 125 
0.096 
0. 126 
0.111 
0. 106 
0.096 
0.111 
0.112 
0. 120 
0.114 
0. 192 
0.073 
0.066 
0. 159 
0. 116 
0.114 
0.091 
0.084 
0. 133 
0. 122 
0. 125 
0.127 
0. 135 
0. 125 
0.117 
0. 100 
0. 143 



Knowiadga of Facts and Concapts Subtast (37 Uams) 



S lop« 
0.266 
0.631 
0.374 
0.658 
0.834 
0.242 
0.575 
0.381 
0.394 
0.763 
0.397 
0.731 
0.376 
^0.465 
0.479 
0.590 
1 . 139 
0.324 
0.750 
0.342 
0.303 
0.597 
0.453 
0.346 
0.383 
0.332 
0.467 
0.572 
0.462 
0.500 
0.402 
0.367 
0.398 
0.471 
0. 741 
0.375 
0.360 



s . a . 

0.053 
0.067 
0.060 
0.047 
0. 137 
0.051 
0.063 
0.07 1 
0.051 
0.072 
0.066 
0.090 
0.083 
0.066 
0.081 
0.050 
0.079 
0.056 
0.086 
0.039 
0.055 
0.070 
0.046 
0.059 
0.068 
0.111 
0.055 
0.086 
0.059 
0.058 
0.051 
0.049 
0.055 
0.063 
0.069 
0.05f 
0.057 



Thr a sho I d 
-0.552 
-1 .098 
-0.041 
- 1 . 1 90 

0.523 

0.324 
• 0.672 

0. 766 

0.893 
-0.038 
-0. 120 
-0.472 

1 .690 
-0. 538 

0. 701 

0.254 

0.446 
-2 . 444 

0.824 
-0.689 

0.851 
-0.815 
-0.314 

0.653 

1 . 575 

4.717 

0.294 
-0. 579 

2.881 

0.423 

0.096 

1 .460 

2.782 
-0.458 

0. 556 

0.219 

3. 136 



s . a . 

0. 121 
0. 130 
0.051 
0.093 
0. 109 
0.085 
0.062 
0. 153 
0. 120 
0.036 
0.055 
0.082 
0.381 
0.095 
0. 134 
0.038 
0.05t 
0.429 
0. 106 
0.085 
0. 161 
0. 104 
0.043 
0. 119 
0.285 
1 .595 
0.057 
0. 101 
0.375 
0.069 
0.046 
0.208 
0.322 
0.077 
0.073 
0.054 
0.480 



As yfflptot a 
6. 167 
0. 135 
0. 145 
0. 136 
0.093 
0. 169 
0. 140 
0. 135 
0. 14 1 
0. 138 
0. 146 
0. 125 
0. 160 
0. 146 
0. 136 
0. 138 
0.110 
0. 157 
0.099 
0. 150 
0. 154 
0. 140 
0. 154 
0. 147 
0. 146 
0.095 
0. 139 
0. 139 
0. 110 
0. 137 
0. 143 
0. 147 
0. 135 
0. 140 
0. 121 
0. 146 
n. 100 



• . a . 

0.OO6 
0.016 
0.013 
0.007 
0.016 
0.016 
0.006 
0.025 
0.017 
0.013 
0.016 
0.015 
0.023 
0.034 
0.026 



0.030 
0.023 
0.014 
0.035 
0.012 
0.027 
0.01 5 
0.025 
0.019 
0.025 
0.014 
0.0t4 
0.034 
0.01 5 
0.026 
0.016 
0.01 5 
0.02 1 
0.01 5 
0.014 
0.013 
0.01 1 
0.009 
0.014 
0.021 
0.017 
0.017 
0.022 
0.027 
0.044 
O.Ol^ 
0.01 7 
0.C22 
0.024 
O.Ol 5 
0.01 7 
0.015 



0.032 
0.036 
0.026 
0.027 
0.020 
0.026 
0 014 
0.024 
0.014 
0.01 7 
0.029 
0.031 
0 07O 
0.032 
0.023 
0.01 7 
0.014 
0.040 
0.01 5 
0.022 
0.020 
0.030 
0.021 
0.02 1 
0.016 
0.01 1 
0.026 
0.036 
0.015 
0.026 
0.030 
0.022 
0.019 
0.036 
0.025 
0.029 
0.016 



ERLC 



I1I-8 



Hi ghar Laval Thi nk i ng 



Subtait (36 Uami> 



I tam 


S 1 opa 


t • a . 


Thr aiho 


E3M 


0. 597 


0.053 


-0. 57P 


E6 


0.471 


0.077 


0.636 


E9 


0. 524 


0.071 


-1 .016 


E 1 2M 


0. 534 


0.052 


-0.273 


E 1 5M 


0.477 


0.046 


-0.051 


E 1 6M 


0. 462 


0.046 


0.477 


E2 1 


0.751 


0. 102 


0.426 


E24 


0.362 


0.061 


-0.366 


E27 


0.617 


0.094 


0.515 


E30 


0. 597 


0.096 


0.604 


E33 


0. 560 


0.089 


0.273 


E36 


0. 741 


0. 104 


-0.353 


E39 


0.415 


0.063 


-0.779 


E42 


0. 660 


0.093 


1 .076 


E45 


0.442 


0.071 


0.091 


M6 


0. 765 


0. 106 


0.396 


M9 


0.7 63 


0.070 


1 .224 


M2 1 


0. 745J 


0.073 


0.976 


M240 


0. 566 


0.052 


2.019 


M27 


0. 371 


0.056 


0 724 


M300 


0.311 


0.052 


2. 135 


M33 


3.361 


0.057 


0.803 


M360 


0.361 


0.039 


0.517 


m39 


0. 396 


0. 116 


4.532 


M420 


0.467 


0.042 


0.795 


M4 5 


0. 357 


0.059 


0.997 


03 


0 . 664 


0.111 


-0. 606 


06 


o!603 


0.076 


0.365 


09 


0.506 


0,0b7 


0.648 


012 


0.552 

0.4&9 


•0.077 


-1 .665 


018 


0.062 


2.366 


021 


0.790 


P . 094 


0.409 


027 « * 


0.925 


0,079 


1 .01 1 


033 


0.464 


0.054 


0. 167 


039 


0.631 


0.076 


-0.635 


045 


0.621 


0.079 


0.799 



* p < .0*^ 
♦* p < .Ci 



t . a. 


Asympt ot a 


1 . a . 


0.061 


0. 125 


0.023 


0. 1 16 


0. 131 


0.024 


0. 149 


0. 139 


0.038 


0.041 


0. 136 


0.020 


0.031 


0. 133 


0.019 


0.059 


0. 122 


0.016 


0.084 


0.112 


0.023 


0.079 


0. 141 


0.032 


0.098 


0. 126 


0.023 


0. 145 


0. 134 


0.022 


0.071 


0. 140 


0.025 


0.076 


0. 130 


0.031 


0. 130 


0. 14^ 


0.036 


0. 164 


0. 101 


0.020 


0.054 


0. 141 


0.028 


0.074 


0. 171 


0.019 


0. 124 


C.091 


0.014 


0. 107 


0. 102 


0.016 


0. 166 


0. 162 


0.010 


0. 117 


0. 155 


0.020 


0.223 


0. 145 


0.011 


0. 127 


0. 150 


0.019 


0.064 


0. 147 


C. 01 7 


1 . 330 


0.092 


O.OlO 


0.079 


0. 126 


0.01 5 


0. 170 


0. 162 


0.020 


0.096 


0. 137 


0.035 


0.069 


0. 159 


0.024 


0.068 


0. 138 


0.023 


0.239 


0. 140 


0.047 


0. 309 


0. 122 


0.015 


0.075 


0. 162 


0.022 


0. 106 


0.085 


0.019 


0.050 


0. ^4? 


0.027 


f 09: 


C. 133 


0.036 


• .097 


C. 1 13 


0.020 



III-9 




ITEM PARAMETER ESTIMATES 
EIGHT SUBTESTS 



Numbtrt Subttst (31 ittmt) 



Ittm 

El 

E2 

E3 

E4 

E5M 

E6 

E7M 

E8 

E9 

E10 

El I 

E12 

Ml 

M2 

M30 

M40 

M6 

M8 

M9 

M10 

Ml 10 

M12 

01 

02 

D5 

06 

07 

08 

09 

01 1 * 

012 



Item 

E37 

E38 

E39M 

E40M 

E4 1 

E42 

E43 

E44 

E45 

M370 

M380 

M41 

M42 

M43 

M44 

M4 50 

039 

040 

04 1 

042 

043 

044 



It«ffi 

E13 

E14 

E15 

E16 

E17 

E18 

E19 

E20M 

E21M 

Mt3 

Mt40 

Ml 50 

M16 

M17 

Ml 80 

M19 

D13 

016 

017 

019 

020 

021 



E22 

E23 

E24 

E25 

E26M 

E27 

E28M 

E29 

E30 

M22 

M23 

m2« 

M25 

M27 

M290 

M30 

022 

023 

024 

02S 

027 

028 

030 



S 1 opt 


s . « . 


Thr t »ho Id 


« . • . 


0.791 


0. 1 24 


0 


.^66 


0. 155 


0.519 


0.086 


0, 


.*/6 


0.096 


0. 709 


0. 104 


-0, 


,323 


0.074 


0.631 


0.099 


'0, 


,628 


0. 113 


0 446 


0. 047 


0, 


,185 


0.038 


0.714 


0.112 


1 , 


,C51 


0. 181 


0. 49? 


0. 058 


1 , 


,651 


0. 199 


0. 548 


0.1*4 


3, 


,084 


0.656 


0.472 


0 08** 


-0, 


,228 


0.065 


0. 658 


0.09b 


-0, 


,921 


0. 145 


0. 583 


0.092 


-0, 


,058 


0.054 


0. 708 


0.082 


-1 , 


,095 


0. 141 


0. 398 


O.C=6 


0. 


,255 


0.054 


0 7b2 


0.082 


-0. 


,516 


0.072 


0. 559 


O.OSO 


0. 


,652 


0.068 


0. 460 


0.046 


-0. 


, 1 16 


0.033 


0. 707 


0.086 


0. 


, 165 


0.050 


0. 439 


0.071 


1 . 


,865 


0.307 


0 836 


0 . 1 0 1 


-0. 


246 


0. 056 


c!500 


0.068 


1 . 


,396 


0. 199 


0 619 


0.059 


0. 


,317 


0.047 


o.e?2 


0.067 


•0. 


*66 


0.045 


1.312 


0. 136 


G. 


512 


0.085 


0.647 


0.078 


0. 


223 


0.057 


0.731 


0.096 


-0. 


652 


0.093 


0.862 


0.087 


t . 


044 


0. 126 


O.BIS 


'0. 103 


0. 


052 


0.055 


0.5T2 


0.061 


1 . 


412 


0. 179 


0.635 


O.C74 


0. 


623 


0.091 


0.956 


0. 1 19 


-0. 


729 


0. .09 


0.330 


0.051 


-1 . 


245 


0.200 



A« ymptot • 
0. 174 
0.185 
0.178 
0. 184 
0. 184 
0. 183 
0. 199 
0. 114 
0.200 
0. 184 
0 177 
0. 175 
0. 199 
0 169 
0. 170 
0.178 
0. 1.^8 
0. 191 
0 174 
0. 169 
0.204 
0.157 
0. 1 15 
0.171 
0. 164 
0. 197 
0.171 
0. 174 
0.206 
0. 172 
0 198 



Algebra Subttst <22 ittms) 



S 1 op« 
0.787 
0.997 
0.77 1 
0.511 
0.668 
0.794 
0.783 
0.614 

0. 593 
1 .090 

1 . 120 
1 . 1 84 
0.843 
0.700 
0.589 
0.528 
1 .409 
0.899 
1 .033 
0. 592 
0.939 
0.7 14 



S I opt 
0.344 
0.341 
0.300 
0.398 
0.270 
0.333 
0.467 
0.373 
0.428 
^0.628 
0.242 
0.479 
0.314 
0.578 
0.227 
0.512 
0.477 
0.456 
0.455 
0.805 
0.422 
0.819 



S topt 

0.583 
0.S17 
0.481 
0.742 
0.569 
0. 729 
0.660 
0. 593 
0.746 
0. 444 
0.4C4 
0.487 
0.855 
0.325 
0.806 
0.972 
0.350 
0.452 
O.S75 
0.592 
0.595 
0. 700 
0.714 



Ctomttry Subttst <22 ittms) 



0.020 
O 025 
.31 

; 01/ 

O.t 19 
0.012 
0.013 
0.030 
0.039 
0.029 
0.042 
0.021 
0.027 
0.014 
0.019 
0.020 
0.016 
0.024 
0.015 
0.016 
0.024 
0.020 
0.025 
0.036 
O.Ot - 
0.027 
0.019 
0.022 
0.038 
0.037 



s . • . 


Thr t sho t d 


1 


1 . t . 


As ympt ot e 


s . « . 


0. 128 


-0. 


,272 


0 


.073 


0. 


,176 


0.031 


0. 183 


0. 


, 141 


0 


.073 


0. 


,159 


0.026 


0.074 


0. 


,930 


0 


. 102 


0. 


,212 


0 013 


0.C59 


0. 


,667 


0 


.086 


0. 


,222 


0 015 


0. 140 


2. 


,019 


0 


.444 


0. 


234 


0.017 


0. 1 13 


0. 


,296 


0 


.074 


0. 


, 160 


0.024 


0. 130 


0. 


,299 


0 


.079 


0. 


164 


0.024 


0.231 


3. 


,695 


1 


.436 


0. 


127 


0.013 


0.095 


0. 


,256 


0, 


,07 1 


0. 


180 


0.027 


0. 100 


0. 


322 


0, 


,053 


0. 


183 


0.016 


0.060 


1 . 


, 198 


0, 


,086 


0. 


174 


0.01 1 


0. 163 


0. 


188 


0, 


,061 


0. 


141 


0.021 


0. 103 


"0. 


183 


0, 


,052 


0. 


163 


0.025 


0.079 


0. 


679 


0, 


,092 


0. 


175 


0.018 


0.070 


1 . 


042 


0, 


, 134 


0. 


183 


0.017 


0.055 


2. 


709 


0, 


,294 


0. 


181 


0.010 


0.117 


0. 


798 


0, 


, 1 10 


0. 


134 


0.02 ■ 


0.062 


1 . 


923 


0, 


, 160 ' 


0. 


124 


0.015 


0.077 


0. 


833 


0. 


,094 


0. 


150 


0.021 


0. 128 


4 . 


259 


0. 


,956 


0. 


121 


0.012 


C 06R 


1 . 


918 


0. 


, 167 


C 


140 


0.015 


0.077 


2. 


735 


0. 


,324 


0. 


149 


0.014 



s . • . 


Thrt sho td 




s . • . 


Xs ympt ot t 


s . t . 


0.093 


0, 


,538 


0 


. 154 


0 


.120 


0.O25 


0.099 


1 , 


,360 


0 


.401 


0, 


,117 


0.022 


0.076 


'-0, 


,668 


0 


. 177 


0, 


, 125 


0.033 


0. 108 


0. 


,476 


0 


. 139 


0, 


, 115 


0.025 


0.073 


0, 


,375 


0 


. 112 


0, 


, 128 


0 027 


0. 105 


2, 


,146 


0 


.681 


0, 


, 109 


0.020 


0. 131 


1 . 


,714 


0 


.488 


0, 


,090 


0.018 


0.057 


1 . 


,36!^ 


0 


.214 


0, 


, 109 


0.013 


0.063 


0. 


,536 


0 


.085 


0, 


,111 


0.016 


0.074 


1 . 


,581 


0 


. 195 


0, 


,079 


0.013 


0.039 


1 . 


,466 


0 


.241 


0, 


,119 


0.015 


0.056 


-0. 


,383 


0 


.053 


0. 


, 1 14 


0.021 


0.070 


-3. 


,570 


0 


.801 


0. 


, 126 


0.049 


0.0b8 


-0. 


, 147 


0, 


,046 


0. 


, 103 


0.024 


0.041 


2. 


,902 


0, 


, 536 


0. 


,117 


C .012 


0.074 


1 . 


, 104 


0, 


, 166 


0. 


,093 


0.017 


0.064 


2. 


325 


0, 


,319 


0. 


,079 


0.015 


0.099 


-2. 


,286 


0, 


,503 


0. 


116 


0.052 


0.065 


1 . 


192 


0, 


, 179 


0. 


, 102 


0.020 


0. ! 1 1 


0. 


621 


0, 


, 103 


0. 


,097 


0.023 


0.063 


1 . 


415 


0, 


,219 


0. 


, 103 


0.021 


0.078 


1 . 


?55 


0, 


, 148 


0. 


082 


0.0^9 


Mt t sur tmtr.l 


; Subttst 


<23 Ittffis) 






s * t . 


Thr t lHo td 


J 


( . t'. 


As yifip' ot t 


s . t . 


0.098 


2. 


237 


r 


391 


0. 


i33 


O.Old 


0.091 


-0. 


025 




,053 


0. 


179 


0.029 


0. 1 13 


3. 


1 10 


o! 


, 744 


0. 


139 


0.014 


0. 134 


0. 


343 


0. 


,088 


0. 


172 


0.024 


0.0S7 


0. 


950 


0. 


, 103 


0. 


173 


0.014 


0. 127 


-0. 


201 


0. 


,069 


0. 


161 


0.031 


0.067 


0. 


515 


0. 


06^ 


0. 


192 


0.015 


0.092 


-0. 


206 


0. 


063 


0. 


166 


0.031 


0.097 


2. 


073 


0. 


289 


0. 


093 


0.015 


0.058 


1 . 


184 


c. 


, 163 


0. 


175 


0.017 


0.056 


-0. 


040 


0. 


040 


0. 


19G 


0.023 


0.062 


0. 


747 


0. 


105 




167 


0.019 


0. 100 


0. 


241 


0. 


0^6 




:o 


0 020 


0. 1 12 


-0. 


364 


0. 


066 


0. 


<S3 


0.027 


0.064 


0. 


691 


0. 


068 


0. 


161 


0.013 


0.114 


0. 


502 


0. 


081 


0. 


154 


0.018 


0.060 


0. 


259 


0. 


064 


0. 


194 ^ 


0.026 


0.069 


0. 


986 


0. 


160 


0. 


178 


0.022 


0.095 


-0. 


Oil 


0. 


050 


0. 


175 


0.028 


0.077 


0. 


813 


0. 


1 18 


c. 


161 


0.021 


0.081 


1 . 


664 


0. 


239 


0. 


170 


0.018 


0.077 


1 . 


427 


0. 


171 


0. 


132 


0.018 


0. 1 12 


0. 


204 


0. 


063 


0. 


172 


0.026 
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Probability and Statistiet Subtist < 14 ittmt) 



I tarn 

E3iM 

E32 

E33 

E34M 

E3S 

E36M 

M320 

M33 

M3S 

D3t 

D33 

D34 

D3S 

D36 



Itam 

El 

E4 

E7M 

E10 

Et3 

E16 

El9 

E22 

E2S 

E28M 

E31M 

E34M 

E37 

E40M 

E43 * 

Ml 

M40 

M10 

M13 

M16 

M19 

M22 

M2S 

M370 

M43 

Dt 

D7 

D13 

D16 

Dl9 

D22 

D2S 

D28 

031 

034 

040 

D43 



S lopa 
0.4'»8 
0.4bS 
0.816 
0.668 
0.648 
0.639 
0.371 
0.377 
0.384 
0.6S6 
0.S04 
0.26S 
0.394 
0.S87 



1 . a . 


Thr • iho 1 d 


s . a. 


At ymptota 


t . ■ . 


0. 072 


3 .487 


0. 596 


0.075 


0.008 


0. 075 


"0. 566 


0. 106 


0. 1 25 


0.032 


0. l05 


-0. 703 


0. 108 


0. 1 10 


0.034 


0 .07 1 


5 1 9 


0.070 


0. 1 07 


O.OlS 


0.068 


1 089 


0 . 232 


0 1 22 


0.052 


w '073 


0!561 


0!073 


0. lOl 


0.0l5 


0.052 


"0. 128 


0.033 


0. 132 


0.019 


0 062 


} .460 


0.245 


0. 130 


0.0l8 


0.063 


1 .672 


0.278 


0. 130 


0.017 


0. 124 


0.449 


0. \Cj 


0.111 


0.024 


0.088 


1 .076 


0. 194 


0.117 


0.020 


0.076 


3.672 


1 .061 


0. 127 


0.016 


0.081 


1 .697 


0.353 


0 125 


0.019 


0. IIS 


-0.596 


0. 127 


0.121 


0.033 



Proeadural Skills Subtatt (37 tf^mt) 



S 1 opa 




1 . a . 


Thr c the 1 d 


1 


t . a . 


Atympt oti 


t . a . 


0.694 


0 


.119 


0. 


, 532 


0. 


, 109 


0. 


1 24 


0.021 


0. 537 


0 


.075 


-0. 


970 


0. 


, 146 


0. 


142 


0.036 


0.557 


0 


.050 


1 . 


111 


0. 


, 106 


0. 


1 r 1 


0.013 


0.630 


0 


.075 


-t . 


,219 


0. 


156 


0. 


1 35 


0.040 


0. 470 


0 


.078 


0. 


406 


0. 


,085 


0. 


1 46 


0.024 


0. 546 


0 


.096 


0. 


348 


0. 


082 


0. 


1 4 1 


0.024 


0.370 


0 


.096 


2 . 


759 


0. 


727 


0 


1 50 


0.016 


0. 727 


0 


. 120 


1 . 


422 


0. 


249 


0. 


097 


0.015 


0.434 


0 


.072 


0. 


258 


0. 


066 


0. 


145 


0.025 


0. 661 


0 


.065 


0. 


295 


0 . 


044 


0. 


134 


0 . 0 1 6 


0.480 


0 


.068 


3. 


437 


o! 


494 


0. 


092 


o!oo7 


0.5»4 


'0 


.050 


0. 


590 


0. 


. 062 


0. 


1 19 


0. 1 5 


o.srs 


0 


.083 


-0. 


533 


0. 


092 


0. 


»3i 


0.032 


0.542 




.061 


0. 


510 


0. 


066 


0. 


188 


0 Ol5 


0.492 




.084 


0. 


237 


0. 


065 


0. 


132 


0.026 


0.296 


0 


.045 


0. 


262 


0. 


054 


0. 


154 


0.023 


0.426 


0 


.044 


-0. 


109 


0. 


032 


o. 


1 59 


0.019 


0.314 


0, 


.053 


2. 


094 


0. 


358 


o. 


? 


0.016 


0.663 


0, 


.066 


1 . 


862 


0. 


197 


0. 


12U 


0.012 


0.323 


0, 


.066 


-3. 


338 


0. 


691 


0. 


154 


0.049 


0.715 


0, 


.068 


0. 


980 


0. 


106 


0. 


107 


0.017 


0.472 


0, 


.058 


1 . 


026 


0. 


134 


0. 


1 4 1 


0.017 


0.589 


0, 


.067 


0. 


365 


0. 


059 


0. 


136 


0.021 


0.697 


0, 


.059 


0. 


282 


0. 


042 


0. 


138 


0.017 


0.785 


0, 


.088 


0. 


572 


0. 


080 


0. 


130 


0.019 


1 .381 


0, 


. 145 


0. 


4 1 1 


0. 


080 


0. 


079 


0.020 


0.54 1 


0, 


.064 


-0. 


1C5 


0. 


048 


0. 


137 


0.028 


0.696 


0, 


.062 


1 . 


9'jO 


0. 


190 


0. 


098 


0.014 


0.770 


0. 


,086 


-1 . 


589 


0. 


192 


0. 


136 


0.052 


0.853 


0, 


.085 


0. 


675 


0. 


090 


0. 


130 


0.021 


0.450 


0, 


.058 


0. 


037 


0. 


045 


0. 


14 1 


0.027 


0.537 


0. 


,060 


0. 


796 


0. 


<01 


0. 


137 


0.021 


0.459 


0. 


,057 


1 . 


967 


0. 


254 


0 


133 


0.017 


0.557 


0. 


,060 


0. 


671 




-)88 


0. 


132 


0.022 


0.335 


0. 


,069 


3. 


682 


0. 


/73 


0. 


162 


0.015 


0.626 


0. 


,067 


2. 


222 


0. 


255 


0. 


121 


0.0l5 


0.702 


0. 


,069 


1 . 


889 


0. 


203 


0. 


1 1 1 


0.0l5 


Knowl adga 


of Fact! and Concapti 


Subtast 


<37 


1 t amt ) 





Itam 


S 1 opa 


1 . a . 


Thr ■« ho 1 d 


• . a . 


Atymptot a 


t . a . 


E2 


0.536 


0.099 


0. 


320 


0.079 


0. 149 


0.026 


E5M 


0.564 


0.060 


0. 


01 1 


0.032 


0.151 


0.018 


E8 


0.402 


0. 120 


3. 


800 


1 . 147 


0. 105 


0.013 


Ell 


0.314 


0.C63 


-0. 


024 


0.048 


0. 1 7 1 


0.029 


E14 


0.369 


0.083 


1 . 


768 


0.403 


0. 169 


0.020 


E17 


0.403 


0.080 


0. 


540 


0. 120 


0. 1 75 


0.025 


E20M 


0.302 


0.051 


. 2. 


201 


0.379 


0. 1 74 


0.012 


E23 


0.427 


0.077 


-0. 


066 


0.051 


0.161 


0.029 


E26M 


0.508 


0.059 


0. 


828 


0. 102 


0. 1 14 


0.014 


E29 


0.660 


0.1 .8 


-0. 


252 


0.071 


0. 140 


0.031 


E32 


0.406 


0.07C 


-0. 


280 


0.068 


0. 154 


0.031 


E35 


0.893 


0.087 


-1 . 


557 


0. 171 


0. 145 


0.052 


E38 


0.481 


0.094 


0. 


453 


0. 104 


0. 164 


0.026 


' 1 


0.40"' 


0.094 


2. 


169 


0.510 


0. 170 


0.019 


.44 


"0.399 


0. 13' 


4 . 


064 


1 . 342 


0.099 


0.014 


M2 


0.746 


O.OfC' 


-0. 


595 


0.078 


0. 145 


0.027 


M8 


0.463 


0.0.4 


1 . 


597 


0.261 


0. 1 70 


0.016 


Ml 10 


0.465 


. 0 . 044 


0. 


156 


0.034 


0. 147 


0.018 


M140 


0.320 


V 0.040 


1 . 


419 


0. 183 


0 165 


0.014 


M17 


0.565 


0.072 


-0. 


1 13 


0.043 


0. 1 54 


0.023 


M23 


0.384 


0.056 


-0. 


247 


0.052 


0. 170 


0.024 


M290 


0.693 


0.056 


0. 


668 


0.066 


0. 139 


0.014 


M320 


0.293 


0.036 


0. 


014 


0.029 


0. 185 


0.018 


M35 


o.ai2 


0.060 


1 . 


964 


0.383 


0. 163 


0.0^6 


M380 


0.7' ft 


0.052 


1 . 


200 


0.094 


0. 135 


O.Ol 1 


M41 
M44 


0.56. 


0.071 


0. 


214 


0.050 


0. 137 


0.02 1 


0.522 


0.074 


0. 


880 


0. 134 


0. 152 


0.018 


02 


0.756 


0.087 


0. 


200 


0.057 


0. 139 


0.026 


05 


0.621 


0.082 


-0. 


701 


0. 106 


0. 151 


0.036 


D8 


0.397 


0.052 


1 . 


fi7S 


0.228 


0. 159 


0.019 


Dl 1 


0.667 


0.080 


-0. 


9t3 . 


J. 120 


0. 145 


0.040 


017 


0.447 


0.0£;5 


t . 


548 


0.201 


0. 152 


0.019 


D20 


0. 764 


0.071 


i . 


234 


0. 132 


0. 140 


0.019 


D23 


0.348 


0.C53 


1 .397 


0.219 


0. 167 


0.021 


D35 


0.584 


0.063 


1 . 


6'»0 


0. 188 


0. 152 


0.018 


D41 


0.898 


0.081 


0. 


7b2 


0.092 


0. 1 12 


0.022 


044 


0.426 


0.066 


3. 


192 


0. 505 


0. 114 


O.OlS 
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Hioher LtvtJ Thinking Subttft OS ittmc) 

Item Stopt I Thrtlhold « Atymptotc «. 

U *'2-''6 O-^^S 0.159 0 0*3 

IS 2-1^^ O'-^S' 0-^02 0.135 0.022 

!?, 5-609 0.076 -0.677 0. lOO 0. 60 0 031 

III 2-i?5 2-2" -'-756 0.224 0 59 oioJs 

III o'lil 2-°'S *2-^'*6 0-^02 0.165 0 631 

EI® 0.479 0.140 2.023 0.602 0 164 0 017 

0-"2 0 070 0.581 0.0?0 oMt O.oll 

lit o'ilt 2-iS2 2 0-953 0.145 0 0 4 

III SJfl 2-9J? "^-56^ 0-093 0.157 0.031 

|?5 2-iJf ^-^50 0.508 0.094 0.015 

l?cu 2-225 -0.790 0.106 0 157 0.033 

lllu o'SiS 2-2?i O'-'O' 0-053 0.137 0 0l3 

H?" 2J2? 0.056 0.875 0.099 0.160 0 014 

^j? 2-5?? 0.096 0.066 0.055 0.15? 0.025 

"ilS 2*155 2-080 0.014 0.054 0.171 0 027 

2'?Z^ 0.041 0.834 0.079 0 161 0 Ol5 

W6 0.664 0.065 0. 186 0.045 0. 131 0 022 

2?, 2-SF 0.073 -0.129 0.045 0.164 0 024 

S ?0 2i?i 2-2Z2 '2-021 0.042 0.146 5 523 

y AO ?s'ln^ 2-250 -0.127 0.033 0.158 0.0l9 

M180 0.404 0.042 2.233 0.237 0 155 O O i 

ilt 0.606 0.057 0.573 O.oU § H gig^i 

SIo 2-212 "2-i" 0.055 0.148 5 525 

^25 2-25^ 0.584 0.070 0.125 0.019 

ni?o 2-2®^ 0 135 0.160 0.016 

M42 0.319 0.044 -0.112 0.041 0.182 0 055 

^50 0.338 0.051 3.539 oisJl 0 67 oiOlO 

2S 2-S?f 2-25^ ^-012 0.108 0.134 0 020 

09 2-^nS 2-2^S 0.440 0.069 0.135 0.025 

nl, 2-12? -2-0^2 -1.569 0.283 O 189 0.037 

2?] 2*153 2-06' 2 025 0.208 J. 144 0 oT? 

olt S-f?A 2-2?2 0.122 0.053 0.166 0 028 

9il ^ - 2-^90 0.068 1.326 0.134 0.127 0 019 

030-^ 0.591 0.077 0.341 O.OGG 



033 0.753 0.071 l!341 0.' 144 o'l79 0 0i7 

cll Sill 2-22S -0.300 0.063 5:16? 5:5]2 

S2? 2'??^ 0.086 1.003 0.116 0.145 0.02O 

0^2 0.422 0.082 4.418 0.876 0.097 o!oi2 

♦ p < .05 

p < .01 
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FORM 5 

ITCM PARAMETER ESTIMATES 
EICHT SUBTESTS 



Number* Subttst (29 ittmt) 



It am 

El 

E2M 

E3 

E4 

E5 

EG 

E7M 

E8 

E9 

ElO 

Elf 

E12 

MfO 

M3 

M4 

M50 



M90 

M10 

Ml 1 

Ml 20 

02 

03 

04 

06 

07 

08 

01 1 



M 
t30 
E31 
E32 
E33M 
E2£ 
E35 
E36 
M28 
M30 
M310 
M32 
M34 
M35 
028 
023 
030 
032 
033 
034 
O-fS 
036 



Ifm 

E37 

E38 

E39M 

E40 

E4t 

E42 

E43M 

E44 

E45 

M370 

M380 



M41 
M42 
M44 

M450 

039 

041 

042 

043 



E13 

EU 

EI5 

E16 

E17M 

E18 

E19 

E20 

E2IM 

M13 

Ml 40 

MI50 

MI6 

M18 

M19 

M20 

013 

016 

017 

018 

019 

020 

021 



SI oc* 
0.404 
0.565 
0 566 
0.376 
0.785 
0.468 
0.884 
0.496 
0.648 
0.418 
0.619 
0.643 
0.607 
0.321 
0.667 
0.424 
0.769 
0. 747 
0.534 
0.506 
0.669 
0.508 
0.578 
0.673 
0.850 
0.422 
0.7^ 
0.8S2 
0.821 



< . • . 

0.063 
0.053 
0.079 
0.062 
0.072 
0.070 
0.080 
0.081 
0. f02 
0.062 
0.077 
0.092 
0.052 
0.046 
0.079 
0.042 
0.075 
0.073 
0.046 
0.057 
0.059 
0.044 
0.066 
0.092 
0. 1 16 
0.061 
* 0.087 
0.077 
■0.082 



Thr •sho I d 

-0.273 
-0.068 
-0.660 
-1 .873 
-1 .855 
-0.368 

0.037 

0. 193 

0. 1 10 

1 .679 
-0.654 
-0.215 

0.060 
-0.4 11 

0.381 
-1 .244 
-C.427 

2.444 
-0.220 
-0.932 
-1 .709 
-1 .087 

0. 186 
-0. 123 
-0. 165 

2.208 

0.311 

0.542 

0.697 



s . t . 

0.064 
0.032 
0. 105 
0.312 
0. 185 
0.073 
0.036 
0.060 
0.057 
0.255 
0.096 
0.059 
0.032 
0.069 
0.063 
0. 127 
0.061 
0.258 
0.035 
0. 1 13 
0. 160 
0. fOO 
0.051 
0.051 
0.057 
0.329 
0.062 
0.071 
0.089 



Asymptot* 

0. 139 
0. 131 
0. 130 
0. 139 
0. 127 
0. 134 
0. 107 
0. 139 
0. 143 
0. 136 
0. 123 
0. 120 
0. 131 
0. 142 
0. 123 
0. 137 
0. 135 
0.058 
0. 132 
0. 13: 
0. 134 
0. 132 
0. 120 
0. 135 
0. 1 19 
0. 124 
0. 124 
0.087 
0. 130 



Algabra Subtatt (23 ittmt) 



S 1 op* 




Thr ■she 1 d 


0.354 


0.068 


-0 


.722 


0.282 


0.045 


1 


.343 


0.50? 


0.080 


1 .035 


0.62L 


0. 103 


0 


.413 


0.483 


0.094 


3 


. 157 


0.414 


0.053 


1 


.790 


0.792 


0. 142 


-0 


211 


0. 790 


0. 101 


1 


1 1 1 


0.407 


.0.081 


2 


548 


0.484 


0.074 


0 


150 


0.47 1 


0.070 


1 


223 


C.545 


0.057 


0 


721 


0.662 


0.097 


0 


515 


0.448 


0.086 


3 


152 


0.660 


0.090 


0 


759 


0.622 


0. 1 13 


-0 


546 


0.380 


0.066 


1 


244 


0.437 


0. 103 


4 


372 


0.451 


0.075 


1 


231 


0.547 


0.097 


-0 


782 


0.315 


0.076 


3. 


312 


0.507 


0.083 


2. 


495 


0.444 


0.083 


-1 . 


386 



S I op« 

0.405 
0.423 
0.404 
0.459 
0.472 
0.415 
0.555 
0.518 
0.665 
0.379 
-0.614 
0.388 
0.493 
0.548 
0.560 
0.518 
0.627 
0.596 
0.607 
0.865 
1 . 195 



S I op« 

0.580 
0.767 
0.485 
0.413 
0.287 
0.572 
0.486 
0.665 
0.527 
0.427 
0.386 
0.307 
0 380 
0.507 
0.422 
0.332 
0.624 
0.455 
0.63C 
0.869 
0.452 
0.795 
0.660 



t . • . 

0. 147 
0.217 
0. 175 
0.086 
0.628 
0.235 
0.068 
O. 157 
0. 512 
0.046 
0. 188 
0.082 
0.087 
0.613 
0.114 
0.111 
0.221 
1 .044 
0.212 
0. 147 
0.802 
0.418 
0.264 



Asymptott 

0. 1 13 
0.121 
0.096 
0.097 
0.068 
0. 1 17 
0.091 
0.076 
0.099 
0. 103 
0. 101 
0.094 
0.093 
0.075 
0.082 
0. 102 
0.115 
0.056 
0. 106 
0. 104 
0. 128 
0.079 
0. 108 



Ctomttry Subtatt (21 Utmt) 



t . t . 


Thr •« ho 1 d 




1 . • . 


0. 108 


3 


.232 


0 


.871 


0.086 


0 


.616 


0 


. 136 


0.087 


. 3 


216 


0 


.695 


0.08 


1 


425 


0 


.283 


0.089 


0 


101 


0 


.054 


0. 131 


4 


036 


1 


289 


0.070 


2 


015 


0 


260 


0.090 


1 


74 1 


0 


31 1 


0. 136 


-0 


099 


0 


059 


0.055 


2 


571 


0 


379 


0.070 


0 


738 


0 


092 


0.080 


4 


252 


0 


883 


0.095 


-0 


326 


0 


075 


0. 1 13 


2 


904 


0 


609 


0. 106 


1 


378 


0 


-*58 


0.059 


2 


363 


0 


. '6 


0.072 


1 . 


198 


0 


• 0 


0.068 


1 . 


746 


0. 


2 1 


0.067 


1 . 


945 


0. 


2 *» 


0. 107 


0. 


472 


0. 


083 


0. 186 


0. 


365 


0. 


089 



Atymptott 
0. 164 
0. 159 
0. 146 
0. 145 
0. 146 
0. 1 1 / 
0. 108 
0. 130 
0. 13£ 
0. 165 
0. 164 
0. 139 
0. 153 
0. 107 
0. 143 
0. 137 
0. 148 
0. t44 
0. 132 
0. 133 
0.111 



M««tur«m«nt Subtatt (23 i t«mt ) 



t . • . 


Thr- af ho 1 d 


t . • . 


0.086 


1 


726 


0.266 


0. 149 


-0 


179 


0.067 


0.082 


2 


256 


0. 392 


0.077 


2 


364 


0.448 


0.047 


-0 


153 


0.038 


0.095 


0 


073 


0.054 


0.082 


0 


832 


0. 151 


0. 1 16 


-0 


414 


0.091 


0.061 


2 


360 


0.281 


0.085 


-0 


618 


0. 130 


0.057 


2. 


333 


0.349 


0.054 


2. 


750 


0.487 


0.078 


0. 


220 


0.060 


0.096 


-0. 


034 


0.0-^1 


0.082 


0. 


40b 


0.088 


0.068 


0. 


957 


0.200 


0.084 


0. 


658 


0. 103 


0.070 


-2. 


509 


0.3d1 


0.090 


0. 


892 


0. 138 


0. 107 


0. 


807 


0. 1 16 


0.077 


2. 


106 


0.365 


0.095 


1 . 


014 


0. 136 


0. 103 


-0. 


270 


0.065 



Atjrmptot* 
0.118 
0. 122 
0. 1 15 
0. 124 
0. 162 
0. 125 
0. 137 
0. 128 
0 1 13 
0. 146 
0. 170 
0. 155 
0. 154 
0. 140 
0. 149 
0. 158 
0. 1 14 
0. 142 
0.119 - 
0.088 
0. 124 
0.091 
0. 129 



s . • . 

0.030 
0.0l8 
0.033 
0.043 
0.052 
0.030 
0.016 
0.025 
0.025 
0.042 
0.033 
0.?28 
0.017 
0.025 
0.019 
0.026 
0.025 
0.010 
0.019 
0.030 
0.042 
0.026 
0.027 
0.029 
0.030 
0.018 
0.024 
0.^22 
0.02C 



o.o: 4 

0.0 5 
O.On 

0 C24 

O.C 13 
O.C 12 
0.O30 
0. ;i8 
0. 316 
0.323 
0 016 
0 014 
0 019 
0 012 
0.018 
C.034 
0.021 
^.01 1 
0.021 
b.035 
0.016 
0.018 
0.040 



s . • . 

0.015 
0.026 
O.OlO 
0.021 
0.030 
0.014 
O.OlO 
0.018 
0.031 
O.Ol 1 
0.014 
0.009 
0.026 
0.01 1 
0.016 
O.OlO 
0.018 
0.017 
0.016 
0.023 
0.024 



t . • . 

0.017 
0.031 
0.016 
0.017 

o.oro 

0.029 
0 023 
0.033 
O.OlO 
0.029 

r .01 1 

O.Ol 1 
0.023 
0.024 
0.022 
0.020 
0.021 
0.052 
0.020 
0.019 
0.016 
0.018 
0.029 



ERLC 



73 

III- 13 



I tarn 

E22M 

E23 

E24 

E25M 

E26 

E27M 

M230 

M24 

M26 

022 

024 

025 

026 

027 



Ittm 

El 

E4 

E7M 

E10 

E13 

EI6 

EI9 

E22K 

E25M 

E28 

E31 

E34 

E37 

E40 ^ 

£43M^ 

MID 

M4 

MIO 

MI3 

M16 

M19 

M28 

M310 

M34 

M370 



04 

07 

013 

016 

019 

022 

025 

028 

034 

043 



ItSM 

E2M 

£5 

E8 

Ell 

E14 

E17M 

E20 

E23 

E26 

E29M 

E32 

E35 

E38 

E41 

E44 

MSO 

M8 

Mil 

M140 

fc20 

M230 

M26 

M32 

M35 

M380 

M41 

M44 

02 

08 

Oil 

017 

020 

026 

029 

032 

035 

041 

044 



S lopa 

0.262 
0.548 
0.656 
0.412 

C.454 

0.356 
0.344 

0.258 
0.330 
C.564 
0.792 
0.513 
0.279 
0.407 



ProbabtMty a„d Stattttict Subtatt (14 it«n*) 

At ymptot • 
O.055 
O.077 
O.078 
O.080 
O.085 
O.088 
O.090 
O.093 
O.050 
O.081 
O.061 
O.081 
O.094 
O.087 

Proctdgr.l Skills Sgbl«$l (36 tl«mf) 





Thr atho 1 d 


• .• . 


0. 070 


4.860 


1 .307 


0.111 


0.314 


0.082 


0. 134 


-0.261 


0.075 


0 . 067 


1 . 543 


0.253 


C.084 


'0.666 


O. 168 


0.063 


-0.253 


0.053 


0.058 


^.218 


O.046 


0.068 


1.119 


0.300 


0.098 


4.230 


1 .261 


0.083 


-1 .379 


0.21 1 


0. 139 


0.326 


0.077 


0.089 


-0. I9l 


O.055 


0 . 06 1 


-2.733 


0.604 


U.076 


-1 .799 


0.339 



Si opa 

0.2S9 
0.268 
0.595 
0.405 
0.4t0 
0.313 
0.281 
0.258 
0.408 
0.517 
0. 534 
0.59L 
0. 504 
0.305 
0.503 
0.566 
0.439 
0.664 
0.395 
0.307 
0.270 
0.388 
0.483 
0.360 
0.250 
0.285 
0.428 
0.574 
0. 577 
0.485 
0.366 
0.450 
0.406 
0. 518 
0.229 
0.466 



t . • . 

0.054 
0.059 
0.063 
0.074 
0.082 
0.073 
0.062 
0.064 
0.052 
0.089 
.0. 1C2 
0.089 
0.085 
' 0.065 
0.063 
0.057 
O.069 
0.073 
0.059 
0.053 
0.050 
0.064 
0.049 
0.082 
0.041 
0.054 
0.072 
0.076 
0.067 
0.077 
0.061 
0.074 
0.063 
0.079 
0.057 
0.067 



Thr«f ho I d 

-0.252 

-2.331 
0.055 

-1 .700 
1 .928 
2.584 
1 .077 
5.346 
1 .657 

-0.715 

0. 344 
-0.368 

1 .729 

1 . 523 
2.232 

-0.033 

0.416 
-0.889 
-0.87S 
-0.020 

0.34 1 

0.208 

0.879 

3.879 

2 . 708 
4.C21 

-0.3D6 

0.297 

0.863 
-2. 172 

2.500 
-1 .355 

0.086 
-0.486 

3.727 

0.623 



t . •. 

0.070 

0 519 
0.032 
0.315 
0.392 
0.61 1 
0.243 

1 .333 
0.216 
0. 133 
0.084 
0.082 
0.300 
0.329 
0.284 
0.030 
0.076 
0. 106 
0. 138 
0.037 
0.073 
0.052 
0.095 
0.897 
0.467 
0. 763 
0.068 
0.060 
0. 1 12 
0.353 
0.421 
0. 228 
0.045 
0.087 
0. 940 
0. 101 



A* ymptot • 
6. 129 
O. 128 
O. 105 
O. 116 
O.097 
O. 11 1 
0. 121 
O.071 
O. -.02 
O. 1 1 1 
O. .^6 
O. tOb 
O.088 
O. 115 
O. 116 
O. 103 
O. 108 
O. 102 
O. 116 
O. 123 
O. 127 
O. 113 
O. 104 
O.084 
O. 107 
O.080 
O. 119 
O.096 
O.085 
O. 113 
O.097 
O. 112 
O. 114 
O. 106 
O. 100 
O. 101 



Knowladys of Facte and Concaptt SubtaTft (38 Itamt) 



S I opa 

0.533 

0.867 

0. 570 

0.488 

0. 749 

0.222 

0.570 

0. 532 

0.785 

0.383 

0.398 

0.469 

0.354 

0.5l9 

0.410 

0.306 

0.469 

0.668 

0.354 

0.375 

0.268 

0.405 

0. 590 

0.576 

0.464 

0.549 

O.501 

0.657 

0. 787 

0.54 1 

0. 554 

0. SOO 

0.22S 

0.431 

0.289 

0 710 

0.556 

0.759 



* . a . 

0.055 
0.077 
0.086 
0.076 
0. 115 
0.036 
0.0^5 
0.082 
0. 104 
0.050 
0. 102 
0.075 
0.059 
0.076 
0.071 
0.C44 
0.089 
0.068 
\ 0.^*48 
V 0.059 
0.039 
0. 104 
0.086 
0.083 
0.051 
0.082 
0.077 
0.086 
0.091 
0.071 
0.069 
0.O66 
0.046 
0.054 
0.056 
0.076 
0.066 
0.094 



Thr atho I d 

-0.008 
-1 .685 

0.237 
-O. 556 
-0.240 
-0.251 
-0.C.3 
.O. 520 
-0.514 

1 . 139 

3.985 

1 .807 

0.442 
-0. 107 

1 .951 
-1 .626 

3.536 
-1 .708 

2.315 

0.650 

0 591 
3.974 
0. 744 
1.141 
0.81 1 

-0.298 

1 .462 
0.096 
0.517 

0. 752 

1 . 132 
1 .760 

-2,878 
1 .098 

2. 134 
2.065 
1 .574 
0.419 



s . a . 

0.031 
0. 170 
0.063 
J. 100 
0.067 
0.050 
0.085 
0.095 
0.089 
0. 154 
1 .036 
0. 297 
0.088 
0.052 
J. 347 
O. 239 
0.677 
0. 181 
0.318 
0.111 
0.091 
1 .029 
0. 1 18 
0. 174 
0.09& 
0.061 
0.231 
0.051 
0.080 
0. 1 10 
0. 151 
0. '*4^' 
0.S99 
0. 147 
0.4 17 
0. 241 
0. 196 
0.074 



As ymptot * 
6. 134 

O. 122 
O. 124 
O. 136 
O. 113 
O 162 
O. 123 
O. 117 
0. 124 
0. 144 
0.088 
0.117 
0. 135 
, 123 
, 128 
149 



O.065 
O. 128 
0. 158 
O. 135 
O. 150 
O.075 
O. 133 
0. 139 
0. 139 
0. 135 
0. 125 
O. 1 18 
0. '01 
O. 128 
0. 120 
0. 126 
O. 161 
0. 1 14 
0. 146 
0. 085 
0. 1 19 
0. 115 



t . a . 

0.008 
0.025 
0.029 
0.012 
0.034 
0.020 
0.0l8 
0.020 
0.013 
0.040 
0.023 
0.028 
0.043 
0.041 



t . a . 

0.030 

0.043 

0.017 

0.042 

0.017 

0.017 

0.024 

0.008 

0.012 

0.034 

0.025 

0.031 

0.017 

0.021 

O.OlO 

0.018 

0.02O 

0.031 

0.029 

0.024 

0.022 

O.023 

0.014 

0.01 1 

O.Olk 

0.009 

0.031 

0.026 

0.022 

0.050 

0.017 

0.041 

0.028 

0.033 

0.018 

0.024 



t . a . 

0.018 

0.051 

0.026 

C.032 

0.030 

0.020 

0.033 

0.024 

0.032 

0.014 

0.013 

0.018 

O.026 

C.029 

0.018 

0.026 

O.OlO 

0.043 

0 Oil 

0.020 

0.017 

0.017 

0.019 

0.016 

0.015 

0.076 

0.016 

0.027 

0.022 

0.021 

0.020 

0.017 

0.044 

0.021 

0.020 

0.017 

0.018 

0.023 



ERLC 
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M>eh«r L*v*t Thinking Subl«»t (36 it«m») 



It*m 
E3 
E6 
E9 
E12 
E15 
EI8 
E2tM 
E24 
E27M 
E30 
E33M 
E36 
E39M 
E42 
E45 
M3 
M6 
M9D 
Mf20 
MtSO 
M18 
M24 
M30 
M42 
M450 
03 
D6 
010 
021 
024 
D27 
D30 
' 033 
036 
039 
042 



S lop* 
0.54 1 

0.442 

0.631 

0.430 

0.646 

0.462 

0.490 

0.410 

0.327 

0.31 1 

0.306 

0.356 

0.402 

0.32B 

0.5C 

0.323 

0.437 

0.452 

0.354 

0. 190 

C 430 

0.257 

0.305 

0.352 

0.326 

0.495 

0.325 

0.383 

0 ^74 

C.81^ 

O wtf 

0.314 
0.493 
0.576 
0.587 
0.408 



t .« . 

0.076 
0.073 
0. 103 
0.069 
0.078 
0.077 
0.056 
0.069 
0.042 
0.060 
0.048 
0.073 
0.058 
0.068 
0.080 
0.058 
0.067 
0.049 
0.044 
0.039 
0.072 
0.054 
0.063 
0.087 
0.052 
0.073 
0.059 
0.056 
.0.074 
0. 100 
0.073 
O.OSS 
0.073 
0.076 
0.070 
0.061 



Thr •flhe 1 d 

-0.612 
-0.328 

0. 104 
-0. 139 

1 .716 
-0.037 

2.013 
-0. 152 
-0.244 

1 .399 

2.015 

2,599 

2.24 1 

3.549 
-0.34? 
-0.552 
-0.704 
-0.435 
-1 .613 

3. 103 
-0.254 

1 .035 

1 .674 

3.446 

2.754 
-0.468 

2.271 

1 .529 
-0.310 

0.395 
-1 .440 

5. 142 
-0.933 
-1 .227 

0.812 

2.006 



t .« . 

0. 100 
0.071 
0.054 
0.051 
0.254 
0.048 
0.235 
0.053 
0.042 
0.276 
0.321 
0.641 
0.325 
0.957 
0.073 
0. 105 
0. 115 
0.055 
C.206 
0.641 
0.056 
0.222 
0.351 
0.856 
0.438 
0.082 
0.418 
0.231 
0.060 
0.072 
0.203 
1 .412 
0. 146 
0. 168 
0. K ) 
0.309 



Atymptet* 

0.085 
0.091 
0.081 
0.066 
0.0S8 
0.085 
0.065 
0.092 
0.094 
0.092 
0.085 
0.083 
0.067 
0.063 
0.065 
0.097 
0.091 
0.090 
0.097 
0.092 
0.092 
0. 102 
0.094 
0.062 
0.083 
0.092 
0.093 
0.080 
0.088 
0.086 
0.091 
0.044 
0.094 
0.092 
0.075 
0.079 



t .9 . 

0.033 
0.031 
0.026 
0.029 
0.016 
0.029 
O.OlO 
0.029 
0.020 
0.022 
0.013 
0.017 
0.01 1 
0.015 
0.031 
0.026 
0.028 
0.021 
0.027 
0.012 
0.025 
0.020 
0.017 
0.012 
0.01 t 
0.030 
0.018 
0.0l9 
0.029 
0.020 
0.04 1 
0.01 1 
0.035 
0.038 
0.020 
0.017 



.05 
.01 



\ 
V 
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FORM 6 

ITEM PARAMETER ESTIMATES 
EIGHT SUBTESTS 



Numbari Subtsit (34 U«mi) 



Item 

El 

E2 

E3 

E4 

E5 

E6 

E7 

E8M 

E9 

EtO 

Ell 

E12 

Ml 

M2 

M3 

M4 

W5 

M6 

M7 

M9D 

M10 

Mil 

M12 

01 

02 

03 

04 

OS 

06 _ 

07 

08 

010 

Oil 

012 



Ham 

E28 

E29 

E30M 

E31 

E32M 

E33 

E34M 

E35 

E36 

M28 

M29 

M310 

M33D 

M35 

M360 

028 

029 

030 

032 

034 

035 



E37 

E38M 

E39 



E41 
E42 



E44 

E45M 

M370 

M39 

M410 

M42 

U44 

038 

D39 

040 

042 

043 

044 

D4S 



lt«« 

E13 

E14M 

E1S 

E16 

E17 

E18M 

E19M 

E20 

E21 

M13D 

MIS 

M16 

M17 

M20D 

M21 

014 

01S 
016 
017 
D18 
019 



Slop* 


• , • . 


Thr • f ho i d 


0.581 


0.089 


-0.403 


0.469 


0.070 


-1 .448 


0.484 


0.079 


0.627 


0.588 


0.098 


0.008 


0.382 


0.064 


-0.387 


0.464 


0.079 


-0.222 


0.657 


0. 106 


0.392 


0.458 


0.046 


-1 .579 


0.607 


0. 100 


0.280 


0.582 


0.097 


0.913 


0.477 


0.075 


-1 .436 


0.548 


0.089 


-0. 103 


0.679 


0.076 


-0.360 


0.394 


'J. 054 


-1 .965 


0.493 


0.055 


-0.639 


0.646 


0.075 


0.696 


0.478 


0.061 


0.497 


0.421 


0.057 


0.113 


0.676 


0.080 


-0. 151 


0.675 


0.051 


0.599 


0. 579 


0.070 


-0. 128 


0.503 


0.059 


-1 .994 


0.783 


0.067 


-0.969 


0.681 


O.C"3 


0.463 


0.437 


0.054 


1 .044 


0.341 


0.052 


-2.127 


0.54J 


'0.064 


'0.869 


C.793 


0.084 


0.216 


0.850 ^ 


O. 106 


-0.040 


0.730 


0.069 


0.932 


0.812 


0.078 


0.595 


0. 7C6 


0.084 


0. 124 


0.460 


0.060 


-1 .401 


0.682 


0.077 


-0.845 



Slop* 
0.487 

0.315 
0.296 
0.466 
0.514 
0.569 
0.531 
0.453 
0.443 
0.673 
0.308 
0.454 
0.661 
0.677 
0.625 
0.807 
0.452 
0.562 
0.840 
0.297 
0.685 



Slop* 

0. 750 
1 .006 
0.676 
1 .048 
0.810 
0.813 
0. 706 
0. 776 
0.557 
0.650 
0.810 
0.708 
1 .072 
0.728 
0.701 

0. 534 

1 . 198 
0.707 
1.385 
1 .042 
0.724 



o.oai 

0. 222 
0. 1 16 
0.053 
0.081 
0.063 
0.085 
0. 165 
0.072 
0. 164 
0.233 
0.05E 
0.058 
0.276 
0.081 
0.092 
0.075 
0.041 
0.045 
0.056 
0.043 
0.240 
0.095 
0.069 
0. 138 
0.328 
0. 113 
0.053 
0.052 
0. 103 
0.077 
0.050 
0. 189 
0. 109 



A»ymptot« 

0. 121 
0. 127 
0. 135 
0. 118 
0. 126 
G. 124 
0. • 15 
0 2 
0. .^3 
0. 120 
0. 126 
0.119 
0. 126 
0. 134 
0. 124 
0.099 
0. 1 10 
0. 142 
0.119 
0.087 
0. 131 
0. 127 
0.113 
0. 107 
0. 1 19 
0. 132 
0. 120 
0.091 
0. 124 
0. 106 
0.092 
0.111 
0. 125 
0. 122 



Algabrs Subtsst (21 U«mi> 



0.093 
0.086 
0.050 
.0.092 
0.064 
0. 127 
0.059 
0. 122 
0. 102 
0.095 
0.054 
0.057 
0.066 
0.089 
0.05<' 

o.oas 

0.062 
0.076 
0.083 
0.047 
0.090 



Thr • sho I (li 

-0.590 
2. 151 
1 .487 

-0.593 
0.429 
0.171 

-0.534 
2.592 
0.561 

-0.098 
0.547 
3.426 

-0.282 

-0.525 
0.429 

-1 .592 
2.323 

-0. 793 
0. 727 

-0.090 

-0.460 



0. 124 

0.591 

0.255 

0. 128 

0.063 

0.068 

0.067 

0.708 

0.141 

0.044 

0. 104 

0.441 

0.042 

0.081 

0.050 * 

0. 188 

0.325 

0.118 

0.092 

0.044 

0.079 



Aiyniptota 

0.119 
0 136 
0. 140 
0. 121 
0. 120 
0.117 
0.117 
0.099 
0. 123 
0.113 
0. 130 
0.080 
0.111 
0.111 
0.098 
0. 1 14 
0.087 
0.117 
0.089 
0. 129 
0. 1 10 



Caomatry Subtatt (21 Uamt) 



Slopa 




» . a . 


Jhr • t ho i d 


I . a . 


1 . 149 


0 


.157 


0.382 


0.096 


0. 744 


0 


.067 


-0.400 


0.051 


1 . 197 


0 


. 143 


0.382 


0.09t 


0.971 


0 


.074 


1 .678 


0. 149 


1.161 


0 


.170 


0.668 


0. 117 


0.828 


0 


. 136 


0.627 


0. 132 


0.647 


0 


.066 


1 .357 


0. 148 


0.757 


0 


. 1C3 


0.302 


0.076 


0.454 


0 


053 


1 . 126 


0. 139 


0.6J0 


0 


056 


1.942 . 


0. 170 


0.590 


^ 2 


093 


0.507 


0.093 


0.614 


V 0 


.074 


0.027 


0.034 


0.662 


0 


123 


2.837 


0.549 


0.884 


0 


100 


1 .446 


0. 182 


0.966 


0 


075 


1 . 165 


0.117 


1 .008 


0 


090 


0.975 


0. 113 


l.SOB 


0 


074 


-0.371 


0.072 


1 .067 


0 


131 


0.451 


0.086 


1 .433 


0 


1 1 7 


0.882 


0. 1 16 


t .231 


0 


1 14 


0.799 


0. 1 10 


0.967 


0 


139 


0. 141 


0.064 



Aiyniptota 

0. 163 
0. 177 
0. 137 
0. 159 
0.201 
0.247 
0.206 
0. 190 
0.206 
0. 195 
0.215 
0.223 
0. 165 
0. '>83 
0. 136 
0. 192 
0.2ia 
0. 195 
190 
C 201 
0. :97 



nt Subtatt (22 ftami) 





K . a . 


Thr • t ho I d 




1 . a . 


0 


.117 


0.658 


0 


.126 


0 


. 107 


0.080 


0 


043 


0 


. 167 


2. 773 


0 


720 


0 


.162 


0.933 


0 


175 


0 


144 


-0.069 


0 


068 


0 


.082 


0.347 


0 


055 


0 


068 


0. 164 


0 


041 


0 


147 


0.994 


0 


211 


0 


103 


0.856 


0 


176 


0 


064 


O.OOl 


0 


034 


0 


094 


0. 1 14 


0 


051 


0 


065 


1 . 347 


0 


138 


0 


094 


0.783 


0 


095 


0 


067 


2.567 


0 


257 


0 


084 


0.043 


0 


047 


0 


066 


0.392 


0 


070 


0 


106 


1 . 164 


0 


144 


0 


074 


0.928 


0 


1 15 


0 


137 


0.865 


0 


129 


0 


085 


1 .568 


0 


162 


0 


112 


-0.842 


0 


142 



Atytnptota 
0.204 
0. 197 
0. 188 
0. 166 
0.229 
0.241 
0.216 
0.240 
0.274 
0.235 
0.222 
0. 188 
0.220 
0.221 
0.215 
0.225 ' 
0.241 
0.? " 
0.. 
0. 181 
0.221 



0.033 
0.043 
0.024 
0.029 
0.033 
0.032 
0.025 
0.030 
0.026 
0.022 
0.043 
0.030 
0.025 
0.038 
0.027 
0.017 
0.020 
0.022 
0.023 
0.014 
0.023 
0.042 
0.033 
0.022 
0.020 
0.043 
0.035 
0.024 
0.025 
0.018 
0.C20 
0.025 
0.039 
0.036 



• . a . 

0.034 
0.019 
0.014 
0.034 
0.016 
0.027 
0.022 
0.016 
0.026 
0.023 
0.021 
0.008 
0.020 
0.028 
0.016 
0.050 
0.017 
0.035 
0.022 
0.029 
0.034 



0.023 
0.022 
0.023 
O.OlO 
0.021 
0.023 
0.012 
0.025 
0.014 
O.OlO 
0.020 
0.018 
0.012 
0.014 
0.017 
0.018 
0.031 
0.022 
0.018 
0.020 
0.026 



c . a . 

0.021 
0.017 
0.015 
0.0*6 
0.027 
0.015 
0.017 
0.020 
0.022 
0.018 
0.022 
0.015 
0.016 
0.009 
0.024 
0.025 
O.Ol 7 
0.02C 
0.017 
0.015 
0.039 



ERIC 
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76 



021 

E22 

E23 

E24 

E25 

£26 

E27M 

M220 

M230 

M240 

M25 

M2^D 

D25 

027 



El 

E4 

E7 

E10 

E13 

E16 

E19M 

E22 

E25 

E28 

E31 

E34M 

E37 

E40M 

E43to^ 

Ml 

M4 

M7 

M10 

M130 

M16 

M220 

M25 

M28 

M310 

M370 

01 

04 

07 

010 

016 

019 

025 

028 

034 

040 

043 



Itam 

E2 

E5 

E8M 

Ell 

E14M 

E17 

E20 

E23 

E26 

E29 

E32M 

E35 

E38M 

E4 1 

E44 

M2 

M5 

Ml 1 

M17 

M200 

M230 

M260 

M29 

M35 

M4 10 

M44 

02 

0% 

08 

01 1 

014 

017 

029 

032 

035 

038 

044 



Stop* 

0.967 
0.410 
0.369 
0.752 
0.425 
0.413 
0.380 
0.397 
0.373 
0. 723 
0. 514 
0.785 
0.309 
0.560 



Prob«b<nty and Statistics Subtatl (13 itams) 

Asymptota 
0.218 
0.082 
0.0*^7 
0 

0. . iQ 
0. 1 10 
0. 108 
0. 133 
0. 1 13 
0.099 
C. 105 
0 076 
0.097 
0. ^02 

Proeadur*! Sk M I s Subtast (37 itams) 



s . a . 


Thr a s ho 1 d 


s . a . 


0 . 100 


0 . 830 


0.111 


0.118 


3 . 097 


0.900 


0 . 108 


3 . 04 9 


0.903 


0 213 


0. 406 


0. 130 


0.084 


- 1 , 383 


0. 280 


0.086 


-1 .042 


0!224 


0.059 


0.902 


0. 145 


0.049 


1 .661 


0.208 


0.047 


-0.403 


0.059 


0.082 


-0.361 


0.052 


0.077 


-0.294 


0.059 


0.067 


0. 794 


0.077 


0.066 


3.664 


0.784 


0.081 


0. 140 


0.050 



SI opa 

0.452 

0.640 

0.564 

0.605 

0.854 

0.423 

0.478 

0.399 

0.32 

0.6' . 

0. 0 

Oisffi 
0.636 
0.488 
0.657 
0.700 
0.579 
0.813 
1 .036 
0.666 
0.377 
0.676 
0.486 
0. 596 
0.499 
0.969 
0.614 
0.904 
0.839 
0.5^6 
0.509 
0.364 
0.688 
0.410 
0.358 
0.P06 





s . «. 


Thr a s^o 1 d 


s . a . 


0 


.070 


-0 


392 


0.079 


0 


. 101 


0 


.006 


0.056 


0 


.090 


0 


.500 


0.098 


0 


.090 


0 


.842 


0. 140 


0 


. 109 


0 


.453 


0.086 


0 


.090 


2 


. 196 


0.474 


0 


.048 


-0 


.007 


0.032 


0 


. 126 


3 


.725 


1 . 184 


0 


.055 


-1 , 


.519 


0.268 


0 


. 095 


-0, 


.387 


0.079 


0 


.064 


-0, 


.405 


0.086 


•0 


.040 


-0, 


.509 


0.062 


0 


. 162 


0. 


,293 


0.084 


0 


.065 


2. 


,034 


0.217 


0 


.050 


1 . 


,244 


0. 1 J3 


0 


.067 


-0. 


,352 


0.055 


0 


.075 


0. 


,856 


0. 105 


0 


.061 


-0. 


, 121 


0.042 


0 


.088 


-0. 


1 10 


0.047 


0, 


.083 


-0. 


280 


0.043 


0, 


,070 


0. 


,865 


0. 102 


0, 


.045 


2. 


233 


0.273 


0, 


.063 


-0. 


165 


0.044 


0. 


.053 


-0. 


083 


0.040 


0. 


.057 


2. 


982 


0.295 


0. 


.043 


1 . 


830 


0. 164 


0. 


, 104 


0. 


523 


0.080 


0. 


,079 


-0. 


593 


0.090 


0. 


,077 


1 . 


081 


0. 1 13 


0. 


100 


0. 


278 


0.062 


0. 


062 


0. 


982 


0. 122 


0. 


078 


-1 , 


151 


0. 184 


0. 


071 


3. 


753 


0.744 


0. 


093 


-1 . 


677 


0.236 


0. 


056 


0. 


104 


0.047 


0. 


052 


-0. 


684 


0. 109 


0. 


065 


1 . 


242 


0. 147 



Asymptote 

0. 160 
0. 142 
0. 147 
0. 128 
0. 1 18 
0. 158 
0. 162 
0. 1 19 
0. 166 
0. 143 
0. 166 
0. 162 
0. 121 
0. 143 
0. 147 
0. 145 
0. 149 
0. 141 
0. 147 
0. 1 18 
0. I 16 
0. 193 
0. 123 
0. 140 
0.092 
0. 127 
O. 126 
0. 159 
0. 149 
0. 1/*1 
0. 168 
0. 155 
0. 141 
0. 149 
0. 1C> 
0. 162 
0. 165 



S I opa 

0.331 
0.345 
0.329 
0. 537 
0. 777 
0. 569 
0.676 
0. 533 
0.622 
0.325 
0.658 
0. 530 
0. 700 
0.545 
'0.452 
0.412 
0.S73 
0.679 
0.&22 
0.560 
0.335 
0. 769 
0.362 
0.800 
0.637 
0.325 
0.427 
0.700 
0. 700 
0.721 
0.572 
0.523 
0. 578 
0.637 
0.600 
0.683 
0. 545 



s . a. 

0.061 
0.068 
0.043 
0.070 
0.073 
0.090 
0. 138 
0. 133 
0.080 
0.088 
0.066 
0. 130 
0.062 
0. 1 14 
0.080 
0.056 
0.069 
0.064 
0.072 
0.' 52 
0.036 
0.050 
0.056 
0.092 
0.059 
0.069 
0.052 
0.072 
0.067 
0. 104 
0.062 
0.061 
0 059 
0.062 
C.077 
0.058 
0.060 



Thr a s ho I d 

-1 .9£5 
-0.433 
-1 .963 
-1 .503 
-0. 16 
-0.304 

0.558 
' 2.556 

•0.918 

2.512 

0.463 

2.301 
-0.502 

0.602 

0. 134 
-1 .748 

0. 560 
-1 .5o6 

0.922 

2.414 
-0. 1 13 

1 .050 

0.688 
-0.400 
-0.080 

2.918 

1 .459 

0.551 

0.96S 
-0.757 

0.305 

1 .243 

2. 233 

1 .070 
-0.327 

1 .362 

1 .095 



s . a . 

0.364 
0. ICO 
0.258 
0.204 
0.037 
0.073 
0. 133 
0.650 
0. 132 
0.686 
0.061 
0.576 
0.056 
0. 141 
0 059 
0.244 
0.080 
0. 155 
0. 137 
0.235 
0.031 
0.079 
1 14 
J65 
* ■>33 
0.621 
0. 184 
0.076 
^. *08 
0. 122 
0.050 
0. i54 
0.k43 
0. 1 18 
0.065 
0. 130 
0. 132 



Asymptota 
0. 181 
0. 184 
0. 184 
0. 168 
0. 149 
0. 162 
0. 157 
0. 145 
0. 1 70 
0. 188 
0. 169 
0.117 
0. 168 
0. 162 
0. 165 
0. 1 74 
0. 138 
0. 160 
0. 196 
0. 1 74 
0. 179 
0. 125 
0. 173 
0. 148 
0. 162 
0. 168 
0. 162 
0. 148 
0. 141 
0. 160 
0. 152 
0. 1 71 
0. 1 16 
0. 141 
0. 160 
0. 132 
0. 156 



s . a . 

0.019 
0.014 
0.016 
0.025 
0.041 
0.038 
0.015 
0.012 
0.020 

o.ni 

0.024 
0.013 
0.014 
0.028 



s . a . 

0.032 
0.029 
0.024 
0.022 
0.C22 
0.018 
0.018 
0.014 
0.041 
0.033 
0.032 
0.021 
0.024 
O.OtO 
0.013 
0.025 
0.016 
0.023 
O 022 
0.019 
0.016 
0.01 1 
0.023 
C.023 
0.008 
0.01 1 
0.021 
0.034 
0.017 
0.024 
0.020 
0.040 
0.014 
0.052 
0.028 
0.033 
0 019 



Knowfadga of Facts and Concapts Subtast (37 itams) 



s . • . 

0.043 
0.031 
0.029 
0.043 
0.018 
0.030 
0.022 
0.015 
0.037 
0.018 
0.015 
0.016 
0.021 
0.024 
0.027 
0.037 
0.019 
0.04 1 
0.017 
C.010 
0 019 
O.C«2 
0.020 
0.027 
0.019 
0.0<4 
0.020 
0. 'J23 
0.020 
0.038 
0.026 
0.020 
0.017 
0.021 
0.033 
0.018 
0.022 
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High«r Level Thinking 



Subtest (37 



1 t«mt > 



It«m 


S lop« 


1 


. • . 


Thr« 


E3 


0.606 


0. 


095 


0. 


E6 


0.61 1 


0. 


099 


-0. 


E9 


0.61 1 


0. 


093 


0. 


E12 


0.752 


0. 


117 


-0. 


E15 


0.642 


0. 


149 


2. 


EISM 


0.655 


0. 


072 


-0. 


E21 


0.576 


0. 


099 


0. 


E24 


0.723 


0. 


1 16 


0. 


E27M 


0.632 


0. 


075 


0. 


E30M 


0.555 


0. 


066 


2. 


E33 


0.754 


0. 


1 16 


0. 


E3S 


0.602 


0. 


101 


0. 


E39 


0.976 


0. 


150 


0. 


E42 


0.654 


0. 


152 


0. 

1 . 


E4 5M 


0.456 


0. 


056 


M3 


0.643 


0. 


101 


-0. 


M6 


0.367 


0. 


062 


0. 


M90 


0.639 


0. 


052 


0. 


M12 


0,616 


0. 


075 


-0. 


M15 


0.720 


0. 


065 


-0. 


M21 


0.646 


0. 


076 


-0. 


M240 


0.606 


0. 


066 


-0. 


M330 


0.876 


0. 


069 


-0. 


M360 


0.797 


0. 


054 


0. 


M39 


0.742 


0. 


086 


0. 


IIU2 


0.7 16 


0. 


too 


2. 


03 


0.544 


0. 


067 


-0. 


06 


1 .372 


0. 


14 1 


0. 


012 


0.712 


0. 


066 


-0. 


015 


0.99Q 


•0. 


074 


1 . 


016 


0.7^? 


0. 


062 


2. 


02 1 


0.764 




062 


1 . 


02 7 ♦ 


0.993 


^ 0. 


092 


0. 


030 


0.649 


0. 


103 


-0. 


039 


0.562 


0. 


054 


1 . 


042 


0.600 


0. 


075 


1 . 


045 


0.772 


0. 


072 


0. 



• p < .05 

p < .01 



f ho 1 d 




At « 


» tote 




685 


0. 129 




236 * 


0. 022 


077 


o! 063 


0 . 


24 5 


0 . 026 


492 


o! 102 


0. 


245 


0.* 023 


1 1 7 


0. 066 


o[ 


2 1 7 


0 026 


550 


o! 6 1 8 




177 


0.0^5 


036 


0. 037 


0. 


165 


o! 0 1 7 


504 


0. 1 10 


0 j 


232 


0 . 024 


625 


o! 125 


0. 


202 


0 . 02 1 


609 


0. 070 


o! 


1 75 


0 . 0 1 3 


045 


o! 326 


o! 


3 1 3 


0 Oil 


229 


o! 077 


o! 


204 


0 02 5 


702 


o! 138 


o! 


223 


0 023 


329 


0. 092 


ol 


1 7U 


0 022 


1 94 


o! 082 


Q ^ 


214 


0 025 


102 


0.141 


Q 


225 




291 


0. 059 


Q ^ 


222 


0 024 


726 


0 .' 127 


Q ^ 


26' 


0 0 1 9 


846 


0 . 066 


Q ^ 


1 60 


0 0 1 3 


83 1 


0 .' 09 1 


Q ^ 


1 ac 


0 03 1 


1 25 


0. 047 


Q ^ 


206 


0 023 


1 80 


o! 048 


Q ^ 


205 


0 024 


043 


0 . 036 


Q 


206 


0.018 


042 


o! 037 


Q 


1 67 


0.016 


667 


0. 06 1 


Q ^ 


191 


0 014 


210 


o! 052 


Q ^ 


177 


0 02 1 


26B 


0 . 337 


0 . 


151 


0 . 0 1 2 


997 


0. 135 


0. 


22 1 


0. 040 


309 


0.073 


0. 


167 


0.024 


379 


0.071 


0. 


213 


0.035 


599 


0. 152 


0. 


249 


0.016 


253 


0.210 


0. 


191 


0.015 


063 


0. 106 


0. 


190 


0.020 


621 


0.067 


0. 


2S2 


0.022 


223 


0.062 


0. 


213 


0.032 


747 


0. 175 


0. 


222 


0.016 


129 


0. 127 


0. 


283 


0.020 


332 


O.ObI 


0. 


165 


0.027 
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FORM 7 

ITEM PARAMETER ESTIMATES 
EIGHT SUBTESTS 



Numb*ri Subt*it (31 {t«ms) 



It«m 

El 

E2 

E3M 

E4M 

E5 

E6 

E7 

E9 

E10 

Ell 

Et2 

MIO 

M2 

M5 

M60 

M7 

MS 

M9 

MID 

Mil 

M12 

02 

03 

04 

05 

07 

08 

09 

DIG _ 
01 1 ♦ 
012 



E19 

E20 

E21 

E22 

E23 

E24 

E25M 

E26M 

e: 

MW 

M20 

M210 

M22 

M23 

M24 

M27 

019 

020 

022 

023 

025 
026 
027 



S I op« 

1.022 
.528 
.627 
.87S 
.947 
.834 
.678 
0.788 
1 .060 
0.954 
0.554 
0.600 

0. 820 

1. 180 
0.825 
0. 590 
0. 727 
1 .023 
0. 744 
0.€'3 
0.665 
0.626 
0. 743 
0. 757 
1 .244 
1.005 
0.948 
0.7d5 
0.907 
0.624 
0.806 



t . • . 

0. 134 
0,081 
0.076 
0.079 
0. 126 
0. 137 
0. 127 
0. 1 18 
0. 136 
0.092 
0.085 
0.050 
0.093 
0.112 
0.071 
0.074 
0. 103 
0.076 
0.079 
0.064 
0.080 
0.083 
0.O75 
0.093 
0.097 
0. 107 
0. 108 
0.079 
0.086 
0.095 
0. 109 



Thf tiho Id 

-0.358 
0. 170 
1.942 
0.398 

-0.294 
0.513 
1 .327 
1 .282 

-0.449 

-1 .201 

-0. 128 

-1. 192 
0.285 
0.983 

-0.434 
1 .04 1 
2.263 
1.558 

-0.372 

-1.317 

-0.057 

-0.034 
0.888 

-0.471 
0.7 14 
0.436 

-1.617 
0.915 
0.339 

-1.453 

-0.203 



0.079 
0.062 
0.251 
0.056 
0.073 

0. 1 to 

0.267 
0.214 
0.086 
0. 136 
0.059 
0. 106 
0.060 
0. 125 
0.053 
0. 143 
0.348 
0. 143 
0.061 
0. 146 
0.048 
0.053 
0. 1 10 
0.080 
0.089 
0.078 
0.203 
0. 113 
0.066 
0.231 
0.064 



Aiymptot< 
0. 182 
0.252 
0.356 
0.22b 
0 196 
0.228 
0 309 
0.220 
0. 187 
0.224 
0.251 
0.236 
0.200 
0.231 
0.20D 
0.26S 
C.333 
0. 131 
0.210 
0.238 
0.245 
0.259 
0.247 
0.227 
0. 149 
0.216 
0.233 
0.243 
0. 184 
0.244 
0.246 



Mm 

E37M 

E38M 

E39 

E40 

E41 

E42 

E43 

E44 

E45M 

M390 

M40 

M41 

M4? 

M43 



037 
038 
040 

041 
042 
043 
045 



Algtbr« SbSttst (24 itams) 



S 1 op« 
0.497 




1 . • . 


Thrasho 1 d 


0 


080 


0. 132 


0. 958 


0 


161 


0.404 


0. 564 


0 


094 


0.454 


0.51 1 


0 


088 


1.248 


0.606 


0 


088 


-0.764 


0. 599 


0 


102 


0.281 


0.451 


'0 


051 


0.526 


0.637 


0 


065 


0.326 


0.628 


0 


096 


-0.587 


0. 583 


0 


075 


0.359 


0.616 


0 


082 


3.060 


0. 594 


0 


068 


-0.322 


0.688 


0 


093 


-0.364 


0. 568 


0 


078 


2.529 


0.494 


0 


068 


0.519 


0.831 


0 


076 


1.385 


0. 724 


0 


106 


-0.877 


0.849 


0 


1 10 


0.607 


0. 537 


0.079 


0.844 


0. 769 


0 


117 


-0.402 


0.466 


0 


067 


0.775 


0.655 


0 


094 


•>.252 


0.696 


0 


086 


^. 194 


0. 753 


0 


123 


-0. 1 16 



C«o./t*try Subt*ft (22 U«mt) 



Ittm 


S 1 opm 


t . • . 


TK/a sho 1 d 




1 . • . 


E28 


0.473 


0.092 


1 


388 


0 


.280 


£29 


0. 404 


0.087 


1 


192 


0 


.265 


E30i< 


0.479 


0.071 


0 


.527 


0 


086 


£31 


0. 760 


0. 158 


0 


17 1 


0 


.071 


£32 


0.702 


0. 126 


0 


685 


0 


139 


£33 


0.414 


0.099 


2 


780 


0 


671 


E34M 


0. 548 


0.076 


2 


284 


0 


326 


E35M 


"0. 576 


0.075 


1 


589 


0 


214 


£36 


0.614 


0. 120 


-0 


400 


0 


097 


M28 


0.4 17 


0.087 


1 


413 


0 


300 


M29 


0.556 


\ 0.103 


0 


761 


0 


150 


M310 


0.364 


V 0.056 


2 


566 


0 


398 


M32 


0.653 


0. 110 


1 


04 7 


0 


185 


M330 


0. 554 


0.056 


1 


903 


0 


201 


M36 


0. 524 


').093 


1 


329 


0 


244 


028 


0.891 


. 1 10 


0 


47 1 


0 


085 


029 


0.547 


0.073 


0 


619 


0 


098 


030 


0.685 


0.091 


0 


073 


0 


055 


032 


0.48< 


0.076 


-0 


316 


0 


070 


034 


0.694 


0. 1 10 


-0 


070 


0 


055 


035 


0.648 


0.077 


1 


137 


0 


152 


036 


0.539 


0.084 


1 


300 


0 


152 



Atynptot* 

0.207 
0.236 
0.207 
0. 175 
0. 176 
0. 195 
0. 190 
0.216 
0.200 
0.229 
0.201 
0.218 
O. 197 
0. 170 
0. 192 
0. 166 
0.206 
0. 185 
0.209 
0.200 
0. 185 
0. 163 



nt Subtatt (22 ttamt) 



S I op* 

0.968 
0.76'* 
0.893 
0.673 
1 .638 
0.681 
1 .295 
1 .396 
0.905 
0.982 
0.852 
0.86S 
1 .053 
0.834 
0.97? 
1.314 

0. 649 
2. 197 

1 . 196 
1 . 730 
0.636 
0.969 



t . • . 

0.031 
0.026 
0.01 1 
0.014 
0 029 
0.021 
0.019 
0.017 
0.032 
0.045 
0.028 
0.028 
0.020 
0.014 
0.022 
0.017 
0.013 
0.012 
0.026 
0.036 
0.023 
0.029 
0.021 
0.035 
K^.02 1 
0.023 
0.060 
0.020 
0.025 
0.048 
0.031 



* . t . 


AtymptOt • 




t . • . 


0.055 


d 


162 


0 


.027 


0.095 


0 


126 


0 


.022 


0.094 


0 


170 


0 


.024 


0.226 


0 


178 


0 


.020 


0. 123 


0 


159 


0 


.036 


0.073 


0 


169 


0 


.025 


0.069 


0 


176 


0 


.016 


0.049 


0 


148 


0 


.017 


0. 105 


0 


161 


0 


034 


0.064 


0 


165 


0 


021 


0.424 


0 


081 


0 


010 


0.049 


0 


178 


0 


021 


0.066 


0 


164 


0 


027 


0.359 


0 


143 


0 


012 


0.084 


0 


167 


0 


021 


0. 142 


0 


1 14 


0 


015 


0. 140 


0 


I5f 


0 


038 


0.098 ' 


0 


14( 


0 


021 


0. 135 


0 


175 


0 


021 


0.082 


0. 


149 


0 


033 


0. 122 


0. 


164 


0 


022 


0.344 


0. 


180 • 


0 


016 


0.292 


0. 


134 


0 


015 


0.057 


0. 


156 


0 


030 



t . • . 

0.021 
0.023 
0.016 
0.057 
0.024 
0.017 
O.OlO 
0.012 
0.034 
0.017 
0.019 
0.01 1 
0.017 
0.01 1 
0.017 
0.023 
0.023 
0.028 
0.031 
0.028 
0.021 
0.019 



f . • . 


Thr atho 1 d 


1 . • . 


Ag vmptot • 


t . • . 


0.081 


-0.07 1 


0.039 




159 


0.017 


0.077 


2. 104 


0.231 


0 


218 


0.010 


0. 107 


-0.428 


0.080 


0. 


171 


0.031 


0.085 


0.704 


0. 108 


0. 


151 


0.021 


0.227 


0.366 


0. 106 


0. 


114 


0.019 


0. 102 


1 . 143 


0. 191 


0. 


239 


0.019 


0. 196 


0.437 


0. 109 


0. 


159 


0.020 


0. 121 


1 .236 


0. 161 


0. 


097 


0.014 


0.062 


1 .22 1 


0. 101 


0. 


162 


0.01 1 


0.057 


0.314 


0.041 • 


0. 


106 


0.016 


0.088 


2.165 


0.251 


0. 


169 


0.01 1 


0. 132 


2.753 


0.466 


0. 


203 


0.01 1 


0.084 


1 .268 


0. 130 


0. 


192 


0.013 


0.089 


. 0.534 


0.078 


0. 


181 


0.018 


0.062 


0.332 


0.043 


0. 


131 


0.016 


0.086 


2.574 


0.242 


0. 


051 


0.010 


0.062 


1 .027 


0. 1 13 


0. 


191 


0.021 


0. 109 


1 . 129 


0. 133 


0. 


105 


0.014 


0.086 


1 .779 


0. 174 


0. 


205 


0.015 


0.085 


1 233 


C. 116 


0. 


115 


0.015 


0.059 


1.74 7 


C. 178 


0. 


202 


0,017 


0.088 


0.356 


0.065 


0. 


153 


0.026 
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Prob«bHity and St«tt«tic» Subtttt (13 U«mi) 



Ifm 


Slop* 


t . • . 


Thr • I ho 1 d 


t • • . 


A 1 ymp tote 




E13 


Q 


. 633 


0.092 




1 65 


0. 162 


0.091 


0. 04 1 


E14 


0 


!629 


0. 122 


0. 


•»1 1 


0. 122 


0.075 


0.020 


Et5M 


0 


.266 


0.045 


0. 


896 


0. >55 


0. 1 10 


0.016 


F 1 L. 
C 1 O 


0 


.254 


0. 065 


2. 


656 


0. 74 1 


0. 108 


0.0^9 


E17 


0 


.920 


0. 103 


1 . 


138 


0. 1.-7 


0 060 


0.0 6 


E 18 


0 


. 646 


0.112 


-0. 


054 


0.052 


0.066 


0.026 


M130 


0 


. 232 


0.056 


3. 


426 


0.685 


0.090 


O.OlO 


M140 


0 


! 34 5 


0.049 


0. 


562 


0.06S 


0.112 


0. 0 1 6 


Ml 60 


0 


. 668 


0.066 


-0. 


094 


0.034 


0.069 


0. 0 1 9 


Ml 70 


Q 


. 638 


0.055 


2. 


221 


0.200 


0.051 


o! 006 


M1B 


Q 


. 566 


0. 109 


0. 


31 1 


0.072 


0 . 069 


o! 020 


015 


Q 


. 599 


0. 107 


-0. 


799 


0. 152 


0.092 


0. 036 


018 


Q 


! 5 1 5 


0.093 


-0. 


64 1 


0. 125 


o!o96 


o!o34 








Pr oc tdu r 


• 1 Sk 


1 1 1 1 


Subt • it (37 


1 t •ml ) 




Ittm 




op» 


s . • . 


Thr • s ho < d 




Al ymptot t 




El 


0 


791 


0.066 


-0 


577 


0.065 


0. 1 39 


0. 03 1 


E4M 


Q 


605 


0.056 


0. 


1 53 


0.035 


0. 1 33 


o! 0 1 6 


E7 


0 


403 


0.074 


0. 


745 


0. 147 


0.173 


0. 023 


E10 


Q 


625 


0.075 


-0. 


7 14 


0. 100 


0. 1 5 1 


o! 032 


E13 


0 


853 


0.072 


- 1 . 


196 


0 119 


0 1 4 t 


o! 040 


E16 


Q 


346 


0.093 


2 . 


939 


0. 799 


0. 137 


o! Ol 7 


E19 


Q 


594 


0.079 


-0. 


1 26 


0.055 


C. 146 


o! 026 


E22 


Q 


395 


0.080 


1 . 


4 56 


0. 302 


0. 165 


0 . 020 


E25M 


0 


44 5 


0.049 


0. 


306 


0.046 


0*. 1 50 


o! 0 1 7 


E28 


0 




0.078 


1 . 


140 


0.225 


0 .' 1^1 


o! 020 


E31 


0 


764 


0.099 


-0. 


1b6 


0.061 


0.139 


0 . r 2 6 


E34M 


Q 


365 


0.073 


3. 


249 


0. 658 


o! 1 96 


0.* o7o 


E37M 


Q 


At 


*0.058 


0. 


Oil 


0. 033 


o! 1 75 


0 * 0 1 7 


£40 


Q 


0. 094 


0. 


650 


0. I6l 


o! 1 52 


0 . 020 


E43 


0 


924 


0. 146 


0. 


308 


0.062 


o! 106 


0 . 022 


MIO ♦ 


Q 


680 


0.051 


-1 . 


204 


o!096 


0. 139 


0 . 030 


M7 


Q 




0.061 


0. 


796 


0 130 


o! 1 66 


0 . 0 1 9 


MIO 


Q 


656 


0.076 


-0. 


509 


0.072 


0.137 


0 . 026 


M130 


Q 


352 


0.059 


3. 


951 


0. 674 


o! 1 59 


0 . 009 


M160 


Q 


654 


0.048 


0. 


091 


0.032 


o! 124 


o! Ol 8 


M19 


Q 


568 


0.075 


0. 


364 


0. 066 


0.179 


0 . 020 


M22 


Q 


4^? 


0.084 


-0. 


478 


o!07 1 


0.132 


0 . 026 


M28 






0.066 


1 . 


038 


0.172 


o! 165 


0 ! 0 1 8 


M310 


Q 


420 


0.043 


1 . 


843 


o! 193 


o! 1 58 


0 .' 0 1 2 


M40 


Q 


6 1 2 


0.079 


1 . 


966 


0. 265 


0.113 


o! Ol 2 


M43 


0 


494 


0.071 


0. 


641 


o! 103 


0.153 


0. 020 


04 


0 


730 


0.085 


-0. 


573 


0!085 


o! 139 


0!036 


07 


0 


660 


>0. 069 


0. 


401 


0.065 


0. ISO 


0.025 


010 


0 


738 


0.072 


0. 


308 


0.058 


0. 121 


0.026 


019 


0 


857 


0. 104 


-0. 


603 


0.093 


0. 131 


0.038 


022 


0 


616 


0.060 


0. 


977 


0. 109 


0. 163 


0.020 


025 


0 


4 54 


0.072 


3. 


055 


0.497 


0. 172 


0.016 


078 


0 


868 


0.085 


0. 


634 


0.085 


0. 145 


0.022 


034 


0 


639 


0.074 


0. 


040 


0.050 


0. 165 


0.028 


037 


0 


607 


0.060 


3. 


174 


0.535 


0.050 


0.010 


040 


1 


197 


0.069 


1 . 


145 


0. 101 


0.075 


0.016 


043 


0. 


466 


0.049 


1 . 


620 


0. 178 


0. 131 


0.019 






K'owltdg* of Facts •nd Con 


ctpts Subtest <38 itamt) 





Itam 


Slop* 


t .m. 


Thr t the 1 d 


I . • . 


As ymptot* 


s . • . 


E2 


0 


377 


0.063 


• 0 


1 17 


0.051 


6. 153 


0.029 


E5 


0 


710 


0.086 


-0 


397 


0.072 


0.115 


0.031 


Ell 


0 


572 


0.071 


-1 


668 


0.215 


0. 131 


0.046 


E14 


0 


643 


0.086 


0 


981 


0. 145 


0. 125 


0.0.9 


E17 


0 


569 


0.075 


1 


543 


0.206 


0.063 


0.018 


E20 


0 


780 


0. 1 14 


0 


502 


0.095 


0. 118 


0.021 


E23 


0 


531 


0.074 


-0 


842 


0. 129 


0. 136 


0.036 


E26M 


0 


502 


0.054 


, 0 


255 


0.042 


0. 126 


0.017 


E29 


0 


337 


0.059 


0 


722 


0. 137 


0. U7 


0.025 


-32 


0 


'35 


0. 1 13 


0. 


459 


0.093 


0. 127 


C.023 


i.^5M 


0 


254 


0.046 


2. 


460 


0.450 


0. 164 


0.013 


E38M 


0 


401 


0.057 


2. 


363 


0.339 


0. 143 


0.01 1 


E41 


c 


767 


0.096 


0. 


7 52 


0. 112 


0.09< 


0.021 


E44 


0 


^28 


0.065 


1 . 


998 


0.284 


0.073 


0.016 


M2 


0 


674 


0.095 


0. 


1 12 


0.046 


0. 132 


0.021 


M5 


"0 


680 


0.090 


0. 


818 


0. 1 19 


0. 139 


0.016 


M8 


0 


297 


0.060 


1 . 


970 


0.402 


0. 180 


0.016 


Ml 1 


0 


557 


0.060 


- 1 , 


610 


0. 179 


0. 131 


0.039 


M140 


0 


501 


. 0.050 


0.' 


563 


0.064 


0. 145 


0.015 


Ml 70 


0 


817 


V 0.047 


1 


954 


0. 125 


0.057 


0.007 


M20 


0 


487 


0.098 


3. 


377 


0.669 


0.074 


O.OlO 


M23 


0 


384 


0.085 


3. 


062 


0.667 


0. 131 


0.013 


M29 


0 


367 


0.057 


0. 


712 


0. 113 


0. 145 


0.019 


M32 


0 


910 


0. 121 


0. 


475 


0.081 


0. t03 


0.018 


M41 


0 


«i3 


0.081 


2. 


157 


0.336 


0. 1 16 


0.012 


M440 

02 


0. 


4 53 


0.043 


0. 


437 


0.052 


0. 131 


0.016 


0 


399 


0.062 


-0. 


561 


0 C^B 


0. 146 


0.032 


05 


0. 


717 


0.070 


0. 


769 


0.092 


0. 106 


0.021 


08 


0. 


674 


0.088 


-2. 


230 


0.302 


0. 130 


0.056 


Oil 


0. 


407 


0.066 


-2. 


357 


0.386 


0. 138 


0.050 


020 


0. 


486 


0.060 


1 . 


132 


0. 150 


0. 158 


0.020 


023 


0. 


630 


0.089 


-0. 


383 


0.074 


0. 124 


0.033 


026 


0. 


407 


0.065 


3. 


043 


0.495 


0. 109 


0.015 


029 


0. 


440 


0.055 


0. 


435 


0.077 


0. 138 


0.025 


032 


0. 


799 


0. 126 


-0. 


298 


0.071 


0. 125 


0.031 


035 


0. 


504 


0.063 


1 . 


144 


0. 154 


0. 131 


0.022 


038 


0. 


517 


0.059 


0. 


798 


0. 104 


0. 128 


0.022 


041 


0. 


389 


0.058 


2. 


401 


0.363 


0. 128 


0.017 



30 

III-20 



High«r L«v«l Thinking Subttst (37 itami) 
|3M 0.385 0.055 i . 543 0.226 0.265 0.0i3 



|36 0.623 0.090 -0.429 0.083 0.206 

E39 0.802 0.126 -0.213 0.070 0.196 

E42 0.568 0.097 1.538 0.276 0.246 

E^5M 0.509 0.068 2.228 0.305 0.203 

**60 0.773 0.065 -0.489 0.055 0 193 

1 . 180 0.098 1 .248 0. 133 0. 120 



M330 0.636 0.054 1.61<3 0 120 0 19» 

M36 0.492 0.075 1 . 530 0. 242 0*222 

M390 0.838 0.059 0.408 0.047 0.'l58 

1.120 0.119 1.069 0.142 0.192 

03 i'V^ 0-066 0.7 13 0.085 0.183 

g?, O'l^^ 0.086 0.8^,6 0. 104 0.221 

5*2 0.863 0. 105 -0.238 0.064 0. 191 

015 0.581 0.069 -0.464 0.074 0.204 

018 0.585 0.066 -0.222 0.056 0.204 

024 , 0.802 0.076 1.0l5 0.116 01224 

027 ♦ 0.712 ^ 0.082 0. 208 0.058 0. 196 



« 81 

ERIC iit-2 1 



0.022 



|6 0.726 0.104 0.616 o! 110 o!2l3 

|9 0.697 0.094 1.092 0.163 0.160 0.0l9 

f L S'SI^ 2-S?i "0.253 0.064 0 196 0 030 

1)5" 2-3!0 0.052 1.73J 0.257 0.269 0.0l3 

0.781 0.115 0.116 0.062 0 i85 O 02« 

0.781 0.115 0.308 olo" oill? oio^ 

E24 0.812 0.128 0.346 0.085 0.204 0 024 

E27 0.529 0.075 -0.4G2 oiosi o!2lO 0 03? 

13?** S-JfS 2-050 0.553 0.073 0.221 0:0l6 

III 2'!®° 0.106 2.292 0.434 0.209 O.O16 

0.033 
0 031 
0.019 
O.O1 • 
0.022 

M12 0.664 6:679 -0.28' o'.OSB o'.ioS o'o24 

M(8 0.894 0.121 0.620 0.092 0.211 0 Ol7 

M210 0.485 0.048 -0.272 0 042 0 2 8 0 020 

M24 0.569 0.077 0.394 0.071 0 202 o:020 

M27 0.722 0.085 1.670 0.212 0.i69 0.014 

« «... ' - O.O1O 

O.O16 
0.015 
0.014 

Xi. U.Ubb g.7 13 0.085 0. 183 0.023 

09. 0.?14 0.08| 0.8^,6 0. 104 0.221 0.020 

0.033 

6:i8i o.oU -oWii "o-.osl 0.^: °o-°olt 

0!028 



030 0.671 0.074 0.368 0.067 0.218 0.026 

036 0.863 0.074 .630 0.166 0.195 0.0l7 

042 0.996 0.067 1.529 0.130 0.126 66 6 

045 1 . 114 0. 108 0.336 0.070 0.150 0.026 

• p < .05 

p < .01 



FORM 8 

ITEM PARAMETER ESTIMATES 
EIGHT SUBTESTS 



Numbars Subtest (32 items) 



Item 

El 

E2 

E3 

£4 

E5 

E6M 

E/ 

ES 

E9M 

ElO 

Ell 

E12 

MIO 

M2 

M3 

M4 

MS 

M7 

MS 

MIO 

Ml 1 

Ml 20 

02 

03 

04 

05 

06 

07 

08 

09 ♦ 

010 
Oil 



Itam 

E19M 

E20 

E21M 

E22M 

E23M 

E24 

E25 

E26M 

E27 

M200 

M24 

M25 

M27 

019 

021 

022 

023 

024 

025 

026 

027 



Itam 

E28 

E29 

E30 

E31 

E32 

E33 

E34 

E35 

E36M 

M28 

M29 

M300 

M320 

M33 



M350 

028 

029 

031 

033 

036 



Itam 

E37 

E38 

E39 

E40 

E41 

E42 

E43 

E44 

E45 

M37 

M38 

M390 

M40D 

M410 

M42 

M44 

M450 

037 

038 

042 

043 

044 



S I opa 
0.610 
0.824 
0.737 
1 .022 
0.664 
0.586 
0.587 
0.322 
0.622 
0.7 53 
0.940 
0.734 
0.433 
0.560 
0.797 
0.724 
0.727 
0.982 
0.445 
1 .46 1 
0.686 
0.949 
0.667 
0.482 
0.480 
0.556 
0.2M 
0.655 
0.698 
n.921 
.541 



Slop* 

0.723 
0.971 
0.401 
0.850 
0.819 
0.509 
0.516 
0.634 
0.351 
0.334 
0.542 
0.899 
0.430 
1 .005 
0.478 
0.893 
0.715 
0.446 
0.642 
0.467 
0.935 



s . • . 

0.071 
0.089 
0.096 
0. 150 
0.087 
0.051 
0.078 
0.059 
0.063 
0. 100 
0. 129 
0. 105 
0.043 
0.055 
0.076 
0.071 
0.081 
0.093 
0.053 
0. 204 
0.067 
0.078 
0.081 
0.067 
0.077 
0.067 
"0.052 
0.091 
O. 104 
0.089 
0.073 
0. 109 



Threshold 
-1 .230 
-0.960 
-0.291 

0.379 

1 .203 

0.487 
-0.218 

0.734 

2. 130 
-0.499 
-0.236 

0. 137 

0.757 
-1 .372 
-0.492 

0.623 

0.791 

0.626 
-0.901 
-C . 009 
-0.072 
-0 145 

0.894 

0.856 
-1 .335 

1 .326 

0.956 

0.048 
-0.238 

1 .310 

1.115 
-0. 226 



0. 155 
0.171 
0.067 
0.089 
0. 172 
0.055 
0.06G 
0. 145 
0. 229 
0.087 
0.069 
0.062 
0.083 
0. 144 
0.066 
0.078 
0. 105 
0.033 
0. 115 
0.064 
0.044 
0.039 
0. 123 
0. 131 
0.221 
0.171 
0. 181 
0.052 
0.063 
0. 150 
0. 161 
0.063 



As ymptot • 
0. 172 
0 157 
0. 148 
0. 155 
0. 143 
0. 172 
0.171 
0.201 
0. 189 
0. 159 
0. 145 
0. 185 
0. 179 
0. 176 
0. 160 
0. 162 
0. 202 
0. 159 
0. 189 
0. 145 
0. 155 
0. 153 
0. 179 
0. 178 
0. 179 
0. 155 
0.210 
0. 162 
0. 165 
0. 162 
0. 178 
0. 169 



Algabrt Subtest (21 items) 



Geometry Subtest (21 items) 



s . e . 

0.042 

0.040 
0.031 
0.021 
0.019 
0.015 
0.029 
0.025 
O.OlO 
0.033 
0.029 
0.025 
0.015 
0.036 
0.027 
0-017 
0.0:6 
0.015 
0.029 
0.020 
0.023 
0.019 
0.021 
0.024 
0.043 
0.020 
0.025 
0.030 
0.033 
0.017 
0.022 
0.032 



s . e . 


Thr • sho 1 d 


1 


. • . 


Asymptote 




I.e. 


0.062 


1 


.01 1 


0. 


097 


0. 130 


0 


.013 


0. 174 


1 


.300 


0. 


257 


0.095 


0 


.015 


0.097 


4 


559 


1 . 


120 


0. 122 


0 


.009 


0.093 


-0 


369 


0 


055 


0. 149 


0 


.022 


0.072 


1 


189 


0. 


118 


0.212 


0 


.012 


,0. 123 


1 


669 


0. 


412 


0. 152 


0 


018 


0. 107 


0 


237 


0. 


07« 


0. 168 


0 


025 


0.061 


0 


859 


0. 


091 


0. 140 


0 


014 


0.067 


-1 


176 


0. 


230 


0. 174 


0 


036 


0.039 


0 


635 


0. 


081 


0. 175 


0 


017 


0.065 


2 


036 


0. 


255 


0. 187 


0 


015 


0.098 


0 


547 


0. 


079 


0. 137 


0 


021 


0.057 


1 


638 


0. 


225 


0. 1 74 


0 


017 


0. 165 


-0 


194 


0. 


070 


0. 13«> 


0 


030 


0.098 


3 


446 


0. 


722 


0. 13 


0 


014 


0.096 


0 


977 


0. 


126 


0. 138 


0 


018 


0. 107 


-0 


306 


0. 


071 • 


0. 155 


0 


031 


0.065 


1 


025 


0. 


158 


0. 168 


0 


022 


Q.088 


2 


441 


0. 


353 


0. 1 19 


0 


015 


0.072 


2 


049 


0. 


323 


0. 158 


0 


017 


0. 128 


0. 


222 


0. 


067 


0. 128 


0 


024 



SI ope 


• . e . 


Thr • s ho 1 d 


• . e . 


Atyn 


xptote 


s . e. 


0.768 


0.088 


2 


.006 


0.247 


0 


055 


0.014 


0.483 


0.080 


1 


073 


0. 188 


0 


125 


0.021 


0.710 


0. 104 


0.856 


0. 140 


0 


097 


0.021 


0.429 


0.082 


2 


054 


0.398 


0 


1 19 


0.018 


0.716 


0. 1 10 


-0 


dl 1 


0.096 


0 


103 


0.034 


0.530 


0.084 


1 


282 


0.213 


0. 


1 14 


0.020 


0.707 


0. 1 18 


-0 


150 


0.060 


0. 


101 


0.030 


0.394 


0. 101 


3 


022 


0.782 


0. 


106 


0.016 


0.401 


0.046 


*1 


050 


0. 125 


0. 


1 18 


0.025 


^0.509 


0.090 


2 


402 


0.433 


0. 


087 


0.01 1 


0.748 


0.121 


0 


007 


0.044 


0. 


105 


0.022 


0.459 


0.046 


0 


855 


0.093 


0. 


107 


0.014 


0.790 


^ 0.0P7 


0 


781 


0.077 


0. 


122 


0.013 


0.551 


V 0.105 


2 


835 


0.554 


0. 


094 


0.01 1 


0.484 


0.051 


1 


630 


0. 178 


0. 


131 


0.012 


0.569 


0.054 


1 


214 


0. 122 


0. 


128 


0.013 


0.823 


0. 124 


-0 


444 


0.088 


0. 


105 


0.035 


0.627 


0.069 


0 


766 


0. 100 


0. 


1 10 


0.022 


0.545 


0.060 


1 


951 


0.223 


0. 


092 


0.017 


0.531 


0.059 


1 


990 


0. 233 


0. 


099 


0.017 


0.648 


0.071 


0 


359 


0.064 


0. 


105 


0.026 








Subti st 


(22 items) 






Slope 


* • e . 


Thr • tho 1 d 


s . e . 


As vmotote 


s . a. 


0.561 


0.004 


-1 . 


551 


0.008 


6. 


082 


0.008 


0.248 


0.017 


0. 


043 


0.081 


0. 


103 


C.009 


0.353 


0.004 


1 . 


079 


0.043 


0. 


079 


0.002 


0.31 1 


0.012 


3. 


554 


0. 183 


0. 


055 


0.002 


0.338 


0.006 


0. 


901 


0 039 


0. 


08 t 


0.004 


0.368 


0.007 


0. 


463 


0.033 


0. 


085 


0.003 


0.407 


0.012 


0. 


397 


0.046 


0. 


080 


0.003 


0.235 


0.047 


3. 


348 


0.907 


0. 


079 


0.003 


0.378 


0.029 


(J. 


528 


0. 127 


0. 


083 


0.004 


0.865 


0. 100 


0. 


696 


0.039 


0. 


151 


0.018 


0.830 


0.068 


1 . 


637 


0.092 


0. 


138 


0.012 


1.272 


0.059 


1 . 


916 


0. too 


0. 


1 19 


0.008 


0.675 


0.046 


1 . 


683 


0. 101 


0. 


134 


O.OlO 


0.81 2 


0.056 


1 . 


122 


0.065 


0. 


146 


0.01 1 


0.948 


0. 109 


0. 


596 


0.042 


0. 


143 


0.020 


0.487 


0.066 


1 . 


321 


0.095 


0. 


191 


0.016 


0.565 


0.049 


2. 


426 


0. 188 


0. 


192 


0.009 


0.784 


0.094 


0. 


360 


0.070 


0. 


178 


0.0J3 


0.627 


0.061 


0. 


890 


0. 103 


0. 


176 


0.019 


0.909 


0.063 


1 . 


840 


0. 155 


0. 


1 13 


o.om 


1.049 


0. ISO 


0. 


233 


0.071 


0. 


161 


0.02b 


0.767 


0.066 


1 . 


189 


0. 123 


0. 


178 


0.018 



III-22 



E13 

E14 

E15 

E16M 

EI7 

£18 

M130 

MM 

MIS 

M17 

M18 

014 

015 

016 

017 

018 



Ittm 

c 1 

E4 

E7 

£10 

E13 

E16M 

E19M 

E22M 

E25 

£28 

£31 

£34 

£37 

£40 

£43 

MiO 

M4 

M7 

MIO 

Ml 30 

m:" 

M2 

M3<. 

Mj7 

M400 

04 

07 

010 

016 

019 

022 

025 

028 

031 

D37 

D43 



E2 
£5 
£8 

£n 

£14 

£17 

£20 

E23M 

E26M 

£29 

Ei2 

£35 

£38 

£41 

£44 

M2 

MS 

M8 

Mf 1 

MM 

M17 

M200 

M29 

M320 

•<350 

M38 

M4 10 

M44 

02 

08 

Oil 

014 

017 

023 

026 

029 

038 

D44 



ProbibiHty and Statitttet Subtttt (16 ittmt) 



sior 






> . • . 


0 ■ 


. 3^4 


0. ioi 


3 . 78 1 




0 , 


. 433 


0.113 


0.699 




0 , 


. 468 


0. 1 20 


0 ! 863 


0.228 


Q 


• 


0.060 


0.* 433 


0 . 092 


Q 




0.095 


-2 ! 5 n 


0 ! 579 


0. 


, 336 


0.09 1 


-O ! 39< 




0. 


, 620 


0.076 


o!a92 


0. 1 14 


0. 


,34 1 


O.082 


2.001 


0.4?? 


0. 


339 


0.080 


1 .920 


0.457 


0. 


296 


0. 101 


-5.4i5 


1 .860 


0. 


4e5 


0. 108 


-0.280 


0.076 


0. 


785 


0. 124 


-0.917 


0 157 


0. 


403 


0.077 


1 .048 


0 207 


0. 


263 


0.066 


2.303 


0.582 


0. 


38C 


0.083 


-3.012 


0.666 


0. 


335 


0.072 


1 .000 


0.22 



At ymptot c 
0.076 
0. 112 
0. 1 10 
0. 126 
0. 125 
0. 127 
0.090 
0. 115 
0.112 
0. 139 
0.119 
0. 1 10 
0.121 
C. 115 
0. 128 
0.121 



Proeeduri i I I I Subtcit (36 ittin) 



SI ope 
0.485 
0. 547 
0.766 
0. f 70 
0. 561 
0. 659 
0.498 
0. 535 
0. 729 
0. 743 
0.441 
0. 622 
0. 969 
0. &45 
0.653 
0. 506 
0.S8: 
0.694 
1 .489 
0. 742 
0. 726 
0.650 
0.655 
0.614 
0.887 
0.449 
U. 5^7 
0.845 
0.475 
* .974 
.702 
J. 599 
0.899 
0.687 
0.625 
0. 787 



I . «. 

0.064 
0.085 
0.099 
0.096 
0. 162 
0.063 
0.054 
0.051 
0. 1 16 
120 
0. .08 
0.092 
0. 125 
0. 1&4 
0. 108 
1.045 
090 
. 087 
">.223 
0.055 
0.080 
0.093 
0.050 
0.071 
0.054 
0.068 
0.066 
0.081 
0.062 
0. 134 
0.056 
0.970 
0. 13S 
0.062 
0.070 
0.086 



fhr 1 1 ho t d 

-1 .536 

0.534 
-0.370 
-0 634 

3.296 

0.252 

1 .426 
-0.480 

0. 195 

2.048 

2.537 
-0. 16R 
-0.463 

3.758 

1 . 183 

0.724 

0.568 

0.703 

0. 102 

1 .643 

0.4S2 

2.76U 

1 . 724 

0. 142 

1 .34 1 
-1 .433 

0. 1 12 

1 . 156 

2.-..07 
-0.012 

1 .301 

2.805 
-0.397 

2. 141 

0.331 

0.297 



0.211 
0. 101 
0.074 
0.097 
0. 946 
0.042 
0. 162 
0.C5C 
0.068 
0.343 
0.635 
0.060 
0.036 
1 .303 
0.211 
0.073 
0.076 
0.086 
0.064 
0. 136 
0.069 
0.415 
0. 143 
0.045 
0.097 
0.225 
0.052 
0. 136 
0.325 
0.061 
0. 121 
0.348 
0.086 
0. 214 
0.065 
0.067 



Ai ymptot e 
0. 174 
0. 172 
0. 163 
0. 158 
0. 134 
0. 159 
0. 162 
0. 1 76 
0. If 5 
0.086 
0. 190 
0. 176 
0. 152 
0. 1C 
0. 163 
0. 175 
0. M3 
0. 147 
0. 138 
0.235 
0. 157 
0 139 
0. 135 
0. 164 
0. 157 
0. 176 
0.181 
0.219 
0.207 
0. 146 
0. 139 
0. 124 
0. 31 
U 155 
0 157 
0 160 



hnowlvdg* of Ficti md Conctpti Subttit .'j3 tttmt) 



S) op* 
0. 538 
0.664 
0.336 
0.4£>4 
1 .022 
0.682 
0.684 
0.355 
0. 566 
0. 54^ 
0.500 
0.491 
0.431 
-0.398 
0. 444 
0.439 
0. 525 
0. 515 
0. 533 
0.332 
0.345 
O.fi^t 

O.L 

0.9 ^ 
0.608 
0 670 
0 684 
0. 561 
0. 540 
0.442 
0. 596 
0 598 
0.505 
0.4 . 6 
0.73& 
0.426 
0.68S 
O.oSS 
0. 775 



0.073 
9. 1 10 
0.069 
0.075 
0.210 
0.079 
C. 1 22 
0.054 
0.061 
0.091 
0.083 
0.118 
0.085 
0. 101 
0. 1 16 
0.060 
0.070 
0.065 
0.069 
0.0£5 
0.072 
0.050 
0 099 
0.063 
0.047 
0.078 
0.048 
0.079 
0.054 
0.055 
0.069 
0.080 
0.058 
0.065 
0.095 
0.059 
0.067 
0.059 
0.065 



Thr tiHotd 
-1 .214 
1.177 
0.590 
-0.283 
0.258 
,-1 828 
2 .448 

1 .755 
0.822 
0.901 

-0.571 

2.590 

0.964 

2.652 

3.071 
-1 .623 

0.726 
-0.894 
-0.043 

2 478 
-4. 783 

0.282 

0.397 

0.833 

1 .209 

1 . 124 

0. 786 

0.439 

0.973 

1 .696 
-0. 239 
-0. 198 
-0.93S 
-2. 519 
-0.044 

2.466 

0.906 

1 .096 

1 .079 



0. 176 
0. 209 
0.131 
0.066 
0.085 
0.225 
0.460 
0.270 
0.097 
0. 163 
0. 107 
0.631 
0.200 
0.682 
0.814 
0.228 
0. 107 
0 121 
0.042 
0.494 
1.013 
0 049 
0.076 
0.070 
0. 102 
0. 141 
0.066 
0.076 
0.111 
9.2^0 
0.058 
0.057 
0. 120 
0.401 
0.055 
0.348 
0. 107 
0. 130 
0.112 



Atymptot 0 
0. 160 
0. 144 

0. 187 
0. 153 
0. 1 14 
0.161 
0. 131 
0 179 
C. 141 
0. 142 
0. 164 
0. 126 
0. 188 
0. 192 
0. 135 
0. 173 
0. 157 
0. 165 
0. 163 
0. 165 
0. 183 
0. 155 
0. 207 
0. 152 
0. 135 
0. Ml 
0. 127 
0. 167 
0. 152 
0. 160 
0. 159 
0. 167 
0. 158 
0. 173 
0. 161 
0. 164 
0. 155 
0. 169 
0. 150 



t . • . 

0.01S 
0.025 
0.024 
C.017 
0.053 
0.032 
0.013 
0.016 
0.016 
0.066 
0.026 
0.040 
0.022 
0.020 
0.055 
0.024 



0 042 
O.CJJ 
0.029 
0.033 
0.013 
0.016 
0.012 
0.021 
0 024 
0.014 
0.016 
0.028 
0.031 
0.013 
0.019 
0.015 
0.017 
0.016 
0.021 
0.01 1 
0.020 
0.01 1 
0.01 1 
0.022 
0.01 1 
0.043 
0.028 
0.019 
0.017 
0.029 
0.018 
0.015 
0.034 
0.015 
0.027 
0.026 



< 0 . 

0.041 
0.019 
0.025 
0.031 
0.025 
0.053 
0.013 
0.013 
0.014 
0.022 
0.034 
0.016 
0.022 
.017 
^.016 
0.03C 
0.018 
0.030 
0 23 
0.015 
0.068 
0.016 
0.019 
0.012 
0.013 
0.015 
0.014 
0 020 
0.022 
0.0t«> 
0.CJ2 
0.031 
0.04C 
O.C56 
0.030 
0.017 
0.02i 
O.Cli 
0.020 



III-23 



H3 



HiQhtr L«v«1 Thinking Subttit (37 ittmi) 

Ittm Slop. , , Th •thold 1... Asymptot. 

"u ^'H^ -0.269 0.066 0.136 0.030 

I?" O-i?? °-°I2 2.948 0.491 0.197 5oo 

III 2-575 0.083 0.112 0.055 0.17t 0.027 

1 5 0.525 0.096 1.339 0.256 0.217 0.020 
l^?u 2-^2f -0.2:6 0.063 0 175 0.030 
E2tM 0.468 O. 102 3.766 C.839 0.116 O 009 
m O-^i!, 0.108 2.836 o:723 5.96 o'.On 
E27 0.490 0.070 -0.731 0.117 0.185 O 035 
|30 0.552 0.095 1.465 0.263 5. 86 SiSTi 
IIL S'Z?? 2-i°S ^-"fi 0 205 0.170 0.019 
E36M 0.537 0.048 -0.707 0.071 0.189 O 023 

2-S2S 2.351 0.505 O. 76 5 017 

lii 2-??2 °-^28 0.798 O 126 0.132 O 020 

£1- 2*555 0.246 0.156 0.020 

2T'>n O.084 -0.471 0.069 0.184 0.026 

"2D i.3l6 0.141 -0.105 0.047 0.161 COIS 

M 6 S'fS? S'S?? A 'V °-2^0 0.205 6:5l5 

0.737 0.077 -0.194 0.049 O 168 n n3T 

ull n-t'A °:^o? S:S?4 

M27 0.613 0.075 1.291 0.172 n 225 n mfi 

JJ?0'> 0.455 0.043 1.402 O. 40 8 ! 200 o'.oll 

S22n °-^22 2.962 0.512 0.115 0.011 

S2f ^072 0.053 1.492 0.094 0.095 0 009 

UaL n-?o S'Ail '^-^^i 0.175 0.022 

n1 2-flI ^-^^5 0.433 0.746 O.OiO 

03 0.066 0.938 0.124 0.191 0.023 

21 0.327 0.051 1.050 0.172 0.216 O 025 

09 1.068 .0.064 1.194 0.121 oMl 5 5l8 

2 5 O.Tii 0.069 1.142 0.124 0.183 0.020 
Si; 2-^3 0.070 1.21 1 0.155 0.196 0.021 
S?i ♦ * 2-i^2 ^' 0.097 4.202 0.956 0.147 0.014 
nli 2-1*' t.094 0.125 0.167 0.022 
nil 2-S^^* 0-722 0.097 O 186 O 071 
222 0.701 O.C65 2.071 0.212 0.156 OO^b 
036 ^957 0.1 18 0.525 0 091 0. 1?6 S 5i5 
0*2 ^.e62 O.C65 1.639 0.1C2 0.110 0.0l5 

• p < .05 

p < .01 



\ 
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